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I.  INTRODUCTION 


In  this  report,  a  method  of  synthesizing  multichannel  random  processes 
with  variable  temporal  and  cross-correlation  properties  is  developed.  This 
synthesis  method  provides  a  capability  to  generate  processes  for  the  evaluation  of 
multichannel  detection  and  estimation  algorithms  currently  being  assessed  [1].  In 
detection  analyses,  this  program  provides  a  means  to  assess  performance 
capability  in  terms  of  a  receiver  operating  characteristic  (ROC)  by  allowing  for 
parametric  variations  such  as  signal-to-noise  (S/N)  and  clutter-to-noise  (C/N) 
ratios,  pulse-to-pulse  correlation  and  cross-channel  correlation  properties. 

In  section  II,  the  vector  observation  processes  of  interest  are  defined 
together  with  their  associated  correlation  matrix.  The  complex  auto-  and  cross¬ 
correlation  functions  are  considered  in  section  III.  These  functions  are  initially 
introduced  in  terms  of  their  quadrature  and  polar  forms.  However,  in  section 
ffl.C  ,  we  propose  a  functional  shaping  approach  which  enables  these  functions  to 
be  considered  directly  in  terms  of  their  correlation  parameters.  This  approach  is 
the  key  feature  which  provides  control  of  the  process  parameters  in  the  synthesis 
procedure.  These  functional  forms,  however,  do  not  necessarily  satisfy  the 
properties  of  correlation  functions.  In  section  III.C.4,  we  discuss  important 
constraint  conditions  on  the  functional  parameters  which  must  be  imposed  to 
satisfy  these  properties.  We  note,  however,  that  these  conditions  are  necessary, 
but  not  in  themselves  sufficient,  to  ensure  the  proper  functional  form  for 
correlation  functions.  Therefore,  care  must  be  used  in  the  parameter  selection 
process  in  order  to  synthesize  physically  realizable  processes. 

In  section  IV,  the  concept  of  ergodicity  of  the  correlation  functions  is 
discussed  in  terms  of  the  temporal  and  cross-correlation  parameters.  This 
relationship  is  of  critical  importance  in  detection  and  estimation  schemes  which 
utilize  parameter  estimation  methods.  Ergodicity  is  the  condition  under  which 
time-averaged  statistics  of  random  processes  approximate  those  obtained  by 
ensemble  averages.  This  condition  is  often  assumed  in  estimation  and  other  signal 
processing  applications.  In  this  section,  the  ergodicity  condition  for  auto-  and 
cross-channel  correlation  functions  is  derived  in  terms  of  fundamental  process 
parameters.  Specifically,  analytic  expressions  are  developed  for  the  variance  of 
the  time-averaged  correlation  functions  for  discrete,  complex  processes.  These 
expressions  provide  a  performance  measure  which  can  be  used  to  specify  the 
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window  size  of  the  observation  interval  required  to  achieve  a  specific  value  of 
this  variance.  A  unique  aspect  of  this  development  is  the  determination  of  the 
functional  dependence  of  these  expressions  in  terms  of  the  process  temporal  and 
ensemble  correlation  parameters.  In  addition,  the  analytic  expressions  are 
simplified  for  the  general  case  of  complex  processes  with  jointly  Gaussian 
quadrature  components  where  the  usual  assumptions  associated  with  a  complex 
Gaussian  process  are  relaxed. 

In  section  V  and  VI,  we  define  autoregressive  (AR)  vector  processes  and 
propose  a  method  for  their  synthesis  in  terms  of  the  correlation  parameters.  This 
method  provides  a  generalization  of  the  single  channel  approach  proposed  in  [2] 
to  the  multivariate  case.  Finally,  in  section  VII,  we  illustrate  examples  of  the 
synthesized  outputs  as  well  as  a  validation  of  the  ergodicity  analysis  discussed  in 
section  IV. 
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n.  THE  VECTOR  PROCESS  DEFINITION 


In  this  report,  we  will  consider  the  synthesis  of  vector  processes  under 
hypotheses  H0  and  Hj,  such  that 


Hi: 

x  (n)  =  £  (n)  +  £  (n)  +  w  (n) 

n  =  1,2,...,N 

Ho: 

i(n)=  £  (n)  +  w  (n) 

n  =  1,2,...,N 

(2.1) 

where  i  (n)  is  a  zero  mean,  wide-sense  stationary  Jxl  received  observation  vector 
consisting  of  J  channels  and  £  (n),  £  (n)  and  a.  (n)  are  zero  mean,  complex 
Gaussian  random  Jxl  vector  processes  describing  the  signals,  non- white 
noise(clutter)  and  white  noise,  respectively.  These  vectors  are  treated  here  as 
uncorrelated  with  each  other.  However,  methods  to  correlate  £(n)  and  £(n)  could 
be  used  to  model  physical  conditions  such  as  radar  multi-path  or  reverberation. 
Furthermore,  w(n)  is  uncorrelated  with  itself  in  time,  but  not  across  channels,  so 
that 


E  [vl  (n)  SLH(k)]  = 


[0] 

Rww«» 


n#c 

n=k 


(2.2) 


where  Rww(0)  is  the  JxJ  correlation  matrix  of  w(n).  The  vector  processes  s.(n) 

and  £(n),  however,  contain  an  arbitrary  correlation  in  time  and  between  channels. 
We  will  consider  the  condition  where  £(n),  £(n)  and  ^(n)  are  jointly  wide-sense 
stationary  processes.  The  correlation  matrix  for  the  observation  data  expressed 
in  index  ordered  form  [3]  is 

=  ^[&1,N&1,n]  (2-3) 


where 


sf,N  »  [ST  (1)  ST  (2)...sT  (N)]  (2.4a) 

iT(k)  =  [xj(k)  x2(k)...xj(k)].  (2.4b) 
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Under  the  condition  of  wide-sense  stationarity,  R2UL  is  a  Hermitian,  positive 

semi-definite  matrix.  We  will  prove  this  below.  Furthermore,  this  matrix  can  be 
written  in  block  form  as 


“  Rjo^O)  RxxC-l)  ...R^-N+ir 

r£(0)  R^(l)  ...R”(N-1)“ 

II 

Rxx(J)  Rxx(°)  •••Rxx(-N+2) 

= 

R^(-l)  R^(0)  ...R^(N-2) 

_Rxx(N-l)Rxx(N-2) . . .  Rxx(0) 

_R^t(-N+l)R^t(-N+2)...  R^(0)  _ 

(2.5) 


where 


Rxx  (I)  =E  [x  (k)  xH  (k-l)]  k  =  1 ,2,...,N 

I  =  0,  ±  1,..„±  (N-l)  (2.6) 


and  the  last  expression  in  eq  (2.5)  results  because  Rxx(l)  =  Rxx(-1).  It  is  noted, 

H 

however,  that  each  block  matrix  of  Rxx  is  not  Hermitian;  i.e.,  Rxx  (I)  *  Rxx0) 

for  MO.  We  also  note  that  RXx  is  block  Toeplitz.  The  superscript  B  denotes  that 
Rxx  is  written  in  block  form  where  each  block  as  defined  in  eq(2.6)  is  a  JxJ 
correlation  matrix  over  the  J  channels. 

We  now  show  that  the  matrix  expressed  in  eqs(2.3)  and  (2.5)  is  positive 
semi-definite[4].  Using  eq(2.4a)  in  (2.3),  we  can  express  the  correlation  matrix 
as 


&J 

II 

r 

^  .. 

i _ 

[iH(l)lH(2)...lH(N)]' 

> 

k. 

Lx(N)J 

J 

(2.7) 


where  we  note  the  dyadic  form  of  the  observation  vector  process.  We  now  let  £ 
be  an  arbitrary  (non-zero)  JNxl  complex  valued  vector.  Define  the  scaler 
random  variable  y  as  the  inner  product  of  £  and  i1  N  so  that 
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y  =  £h^1)N.  (2.8) 

Taking  the  Hennitian  transpose  of  both  sides  of  eq(2.8)  and  recognizing  that  y  is 
a  scaler,  we  obtain 

y*  =  ii^N  £•  (2.9) 


Eqs  (2.8)  and  (2.9)  can  now  be  used  to  obtain 

E[  lyl2]  =  E[  yy*]  (2.10a) 

=  E[  £H  i1N  s"N  a  (2.10b) 

=  E[  il  .N  4l  ,n!  £  (2. 1 0c) 

=  SHRji£  (2.10d) 

where  Rxx  is  the  correlation  matrix  defined  in  eqs(2.3),  (2.5),  and  (2.7).  Since 

E[lyl2]>0  (2.11) 

then 

£HRXX£>0  (2.12) 


so  that  **xx  is  positive  semi-definite.  We  note,  however,  that  the  correlation 
matrix 


Rxx(0  =  E[  x(k)  xH(k-l)] 


(2.13) 


is  not  Hermitian  for  I  ^  0.  Thus  eq(2.10d)  does  not  hold  for  Rxx(l).  It  is  the 

property  that  the  correlation  matrix  is  expressed  in  the  dyadic  form  of  eq(2.7) 
that  provides  the  non-negative  quadratic  expression  noted  in  eq(2.12).  This  very 
specific  structure  of  the  correlation  matrix  imposes  restrictions  on  the  functional 
form  of  the  auto-  and  cross-correlation  functions  and  must  be  considered  in  the 
functional  shaping  method  described  in  this  report. 
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m.  COMPLEX  CORRELATION  FUNCTION  AND  SPECTRAL  PROPERTIES 

In  this  chapter,  we  consider  the  complex  auto-  and  cross-correlation 
functions.  In  section  m.A,  these  functions  are  presented  in  terms  of  the  in- 
phase(I)  and  quadrature(Q)  form.  This  form  will  be  helpful  in  developing  some 
interesting  properties  of  complex  auto-  and  cross-correlation  functions  not  often 
addressed  in  the  literature.  The  polar  form  of  these  functions  is  considered  in 
section  IQ.B.  This  form  will  enable  us  to  consider  correlation  functions  (and 
thus  spectra  through  the  Fourier  transform)  with  general  shapes,  subject  to 
constraint  conditions  imposed  on  correlation  functions.  Furthermore,  these 
general  functions  will  be  expressed  in  terms  of  various  correlation  parameters. 
These  considerations  arc  discussed  in  section  III.C.  In  chapter  V,  these  forms  of 
the  correlation  function  are  then  used  in  a  method  to  synthesize  Gaussian 
autoregressive  processes  with  various  spectral  shape.  In  section  m.D,  the  spectral 
properties  associated  with  complex  autocorrelation  functions  arc  considered. 
Finally,  in  section  III.E,  several  properties  associated  with  the  even  and  odd 
components  of  the  correlation  functions  are  presented;  in  addition,  some 
important  properties  of  narrowband,  stationary,  bandpass  processes  arc  reviewed. 
A.  In-Phase  and  Quadrature  Component  Form 

In  this  section,  we  consider  the  form  of  the  complex  auto-  and  cross 
correlation  functions  in  terms  of  an  in-phase(I)  and  quadrature(Q)  form. 

Consider  the  wide-sense  stationary,  zero-mean,  complex  Gaussian  baseband 
process  {xj(n)}  for  channel  i  expressed  in  terms  of  its  in-phase  and  quadrature 

components  such  that 

Xj(n)  =  xjjfo)  +  jxig(n).  (3.A.1) 
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For  jointly  stationary  processes,  the  cross-correlation 
autocorrelation  (i=j)  function  is  expressed  as 

Rij(l)  =  E[xi(n)x*(n-I)] 

=  E{[xi!(n)  +  jxiQ(n)][xj!(n-l)  -  jxjQ(n-l)]} 

=  {E[xji(n)xji(n-I)  ]+  E[xiQ(n)xjQ(n-l)]} 

+  j{E[xiQ(n)xj!(n-l)]  -  E[xii(n)xjq(n-I)]} 

=  (R-](l)  +  Ry°d)}  +  j{Ry‘(l)  -  Ry\l)} 

=  RA..d)+jRBijd) 

where 

RA. .(I)  =  Ryd)  +  Ry^l) 

RB. .d)  =  Ry'(l)  -  Ry*d) 
and 

Ryd)  =  EfxjjWxj^n-l)] 

Ry%  =  E[xjQ(n)xjQ(n-l)] 

Ry\l)  =  E[xji(n)xjQ(n-l)] 

Ry'd)  =  E[xiQ(n)xj,(n-l)] 


1The  subscript  j  for  channel  j  should  not  be  confused  with  V-l. 


(i^j)1  and 

(3.A.2a) 

(3.A.2b) 

(3.A.2c) 

(3.A.2d) 

(3.A.2e) 

(3.A.3a) 

(3.A.3b) 

(3.A.3c) 

(3.A.3d) 

(3.A.3e) 

(3.A.3f) 
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We  note  that  the  correlation  functions  in  eqs(3.A.3)  are  real.  In  section 
III.E,  we  will  discuss  some  interesting  properties  regarding  the  evenness  and 
oddness  of  these  functions.  For  stationary  processes,  we  have  the  property 

Rij(D  =  R*i(-I).  (3.A.4) 


PROOF 


Consider 


Rjj(n,n-I)  =  RyO)  =  E[Xi(n)Xj  (n-l)] 


(3.A.5) 


Rji(n-U)  =  Rji(-I)  =  E[xj(n-l)Xi  (n)] 


From  eq.(3.A.6) 


Rji(-I)  =  E[xj(n)Xj  (n-l)]. 


(3.A.6) 


(3.A.7) 


The  proof  follows  from  the  equivalence  of  the  RHS  of  eqs(3.A.5)  and  (3.A.7). 
The  autocorrelation  property  follows  when  i=j  so  that 

Rii(D  =  R*i(-D.  (3.A.8) 

We  now  consider  the  complex  process  Xj(n)  to  consist  of  a  signal  sj(n)  plus 
an  additive  disturbance  such  that 

xj(n)  =  Sj(n)  +  Cj(n)  +  Wj(n)  (3.A.9) 

where  q(n)  and  Wj(n)  are  additive  non-white  and  white  noise  processes  on 

channel  i,  respectively.  In  section  III.C,  we  develop  functional  forms  of  the 

correlation  functions  for  the  signal  and  disturbance  processes  which  will  allow 

considerable  flexibility  in  modeling  these  processes.  In  quadrature  component 
form  Sj(n)  is  expressed  as 

Si(n)  =  sjj(n)  +  jsjQ(n). 


(3.A.10) 


For  stationary  processes,  the  correlation  function  for  the  signal  process  can 
be  written  using  eq(3.A.2e)  as 


Rsij(D  =  RSAij(l)  +  jRSBij(l) 

(3.A.11) 

where 

C  II  QQ 

RAjj(l)  =  Rsyfl)  +  Rsy  (1) 

(3.A.12a) 

and 

s  Qi  IQ 

RBijO)  =  Rsyd)  -  Rsy®. 

(3.A.12b) 

The  corresponding  disturbance  correlation  function  is  expressed  as 
%©  =  RcyO)  +  RWij(l) 

(3.A.13a) 

=  [R^..(l)  +  jRg.  .(1)]  +  [RAy(l) + jRBjjd)]. 

(3.A.13b) 

At  1  = 

0,  from  eq(3.A.2e) 

Rgij(°)  =  RAij(0)  +  jRlij(°)  8  =  s’c’w 

(3.A.14) 

where  g  is  used  to  denote  s,c  and  w;  ie.,  the  signal,  non-white  and  white  noise 
processes,  respectively.  However,  we  also  have  the  definition 


Rgii«» 

°giia8jj 


g  =  S,c,w 


(3.A.15) 


where  p2..  is  the  complex  cross-correlation  coefficient  for  processes  { gj }  and 

olj 

{gj},  Og..  and  Ogjj  are  the  standard  deviations  associated  with  each  channel 
process  i  and  j,  respectively,  with  corresponding  variances 
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°gii "  Rgii(0) 

g  =  s,c,w 

(3.A.16a) 

and 

o^..  =  Rff..(0) 
gJJ  gJJ 

g  =  s,c,w. 

(3.A.16b) 

From  eqs.(3.A.14)  and  (3.A.15),  we  see  that 

RAi/°) =  Re[Pgijl°gii°jj 

(3.A.17a) 

and 

RBij^  =  Im^pgij^°giiCFjj* 

(3.  A.  17b) 

Eqs.(3.A.17a)  and  (3.A.17b)  relate  the  constants  R^.j(O)  and  Rg.j(O)  to  the  cross 

correlation  coefficient  and  the  channel  standard  deviations. 

Finally,  for  the  autocorrelation  function  (i=j),  Rg^(l)  peaks  at  1=0.  The 

cross-correlation  function  Rg.j(l),  however,  does  not,  in  general,  peak  at  lag  zero. 

We  designate  it's  peak  value  as  lag  lg.„ 

B.  Polar  Form 

In  polar  form,  the  cross-correlation  functions  introduced  in  the  previous 

section  are  expressed  as 

fa  2  a  211/2 

V')- ■[%(')]  +[RBij<l>]  •  expUegijd)]  (3.B.la) 

k  a 

=  lRgij(l)l  exp[j0g.j(l)]  g  =  s,c,w  (3.B.lb) 

where 

0gij(l)  =  tan^IRljjOVR^O)].  (3.B.2) 
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g 

For  the  autocorrelation  function  (i=j),  the  imaginary  part  Rg..(l)  is  an  odd 
function  of  I  (see  section  m.E)  so  that  at  1=0,  0g..(O)  =  0.  Therefore,  Rg..(0)  is 

real.  It  is  the  variance  of  the  zero  mean  process  and  represents  a  measure  of  the 

total  power  in  the  corresponding  power  spectrum.  We  have  designated  this 

2 

quantity  for  the  channel  i  processes  as  <?g..  [see  eq(3.A.16a)]. 

g 

For  the  cross-correlation  function  (&j),  Rg.j(l)  is  not  in  general  odd.  Thus 
0g  (0)  is  not  necessarily  zero.  And  so,  in  general,  the  quantity  Rg.j(O)  is 

complex.  We  will  designate  this  quantity  as  the  complex  constant  Gjj  such  that 

Rgij(O)  =  Gij  -  (°A)ij  +  J(GB)ij  (3.B.3) 

where  G  =  S,C,W  for  signal,  non-white,  and  white  noise  processes,  respectively. 
Using  eqs(3.A.14),  (3.A.17)  and  (3.B.3),  we  have 


RAi/°)  “  (GA)ij  “  Re[Pgij]<Tgii°jj 


and 


►8 


”  ^GB)jj  -  l™[Pgjj]0gijay 

In  addition,  we  also  have  from  eq.(3.A.15)  and  (3.B.3) 


(3.B.4a) 


(3.B.4b) 


Rgij(°)  =  Gij  =  (Pgij)  agii  agjj* 
From  eqs(3.B.l),  (3.B.4a)  and  (3.B.4b),  at  1=0 


(3.B.5) 


Rgi/0)  =  i 


,g 


g 


[RAy(O)]  +[R|jj(0)] 


1/2 


exp{jeg.j(0)] 


(3.B.6a) 


=  Ipg  J  agji°gjjexp[j0gjj(O)]. 


(3.B.6b) 


From  eqs(3.B.5)  and  (3.B.6b),  we  have 


Pgij  =  lpgylexP[j9g-j(0)] 

(3.B.7a) 

or 

Ipgyl  =  PgijexP(  “j0gij(O)l* 

(3.B.7b) 

We  can  also  develop  additional  relationships  involving  the  phase  and 
amplitude  between  Rg..(l)  and  Rg..(l).  Using  the  same  form  as  eq.(3.B.l)  for 

%('>. 

we  have 

Rgjj(l)  =  { [RAji®]2  +  tRIji<D]2  } 1/2  exp[jegji(l)] 

(3.B.8a) 

=  iRgjjO)!  exp[j0gjj(l)]. 

(3.B.8b) 

From  eq.(3.A.4),  we  have 

Rgij(D  =  tRgji(-0]*- 

(3.B.9a) 

Using  the  conjugate  property,  we  have 

lRgij(l)l  =  lRg  (-1)1. 

(3.B.10) 

and 

(3.B.11) 

Eq  (3.B.11)  implies  an  odd  relationship  between  0g.j  (I)  and  0gj.(l);  however, 
we  emphasize  that  these  phase  terms  are  not  in  themselves  odd  functions;  ie., 
0gjj(l)  does  not  in  general  equal  -0g.j(-l).  In  particular,  we  note  that  0g.j(O)  is  not 
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4* 

necessarily  equal  to  zero.  For  i=j,  however,  the  relationship  Rg..(-I)  =  [Rg..(l)] 
provides  us  with  the  expression  (see  section  m.E.l.a) 

QgijC-O  =  -0gii(|)  (3.B.12) 

indicating  that  the  phase  function  for  the  autocorrelation  function  is  odd. 

C.  Correlation  Function  Shaping  Approach 


1.)  General  Development 

We  now  consider  modeling  the  cross -correlation  function  Rg.j(l)  with 

functional  forms  that  will  enable  us  to  obtain  generalized  distributions  for  these 
functions  as  well  as  the  autocorrelation  function.  We  express  these  equations  as 

Rgjjfl)  =  ^gij^g^gij’  ^  1^0/  g=s,c  (3.C.1) 


where  X.g.j  is  defined  as  the  temporal  cross-correlation  coefficient  for  #j  and  the 

temporal  autocorrelation  coefficient  for  i=j.  It  provides  a  measure  of  the 

correlation  between  successive  pulses  on  a  given  channel(i=j)  or  between  channels 
(&j),  and  is  discussed  further  in  section  1II.D;  Kg..  is  a  real,  constant, 

normalizing  coefficient  which  will  be  derived  presently;  Ig.j  is  the  lag  value  at 
which  the  corresponding  real  function  fg(«)  has  a  peak  value  of  unity.  We  note 


that  the  cross-correlation  function  does  not  necessarily  peak  at  lag  zero  as  the 
autocorrelation  function  does;  ie.  for  i=j,  ’gii  =  °-  The  functions  f(»)  are  selected 


to  specify  the  shape  of  the  correlation  function  magnitude  and  will  be  considered 
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below.  Using  I  =  0  in  eq(3.C.l)  together  with  the  definition  used  in  eq(3.B.3),  we 


have 


Rgi/°)  =  GU  =  Kgijfg^gij*  *_,gij^l=OeXp^0gij^°^‘ 


Solving  eq(3.C.2)  for  the  normalizing  coefficient 

G-* 

K«..  =  - ^ - j — exp{-j0e..(O» 

g«  uv.  glJ 

g  gy’  Si/  j=0 
so  that  eq(3.C.l)  becomes 


(3.C.2) 


(3.C.3) 


Gijfg(X.g..,  l-lg..) 

Rgjj(,)  =  77: - rj— p1-  exp  {j[0g  (l)-eg  (0)] } .  (3.C.4a) 

fg^gjj*  "  gij'  |asO 

Also,  eq(3.A.4)  enables  us  to  obtain 

%(')= %(-')]’ 

Gii^g^gii’  ~^gii^ 

exp{-j[Qg..(-l)-9g..(0)] ).  (3.C.4b) 

Vhiy  '''gi/ 1=0 

The  normalizing  procedure  presented  above  was  utilized  so  that  at  1=0,  we  have 
Rg.j(0)  =  Gjj  =  (Pgij)°gii°gjj  as  noted  in  eq.(3.B.5).  When  the  equality  in 

eq.(3.B.5)  is  used  in  the  above  equations,  we  obtain 


Rgij(D  = 


(pgii^cgii°gjifg^gij’ 1  ’  'gi^ 


f  Z  r,  - ^-pUteg  (O-eg  (0)]} 

fg(*gjj’ 1 '  lgjj>li=0 _  J 


(3.C.5a) 


or  from  eq(3.B.7b) 


g  =  s,c 


Ipa. JOo..Ga<<fa(X,o..,  I  *  !«*•) 

Rgjj(l)  =  — J — “  gjj  8  8lJ. - ^pUieg.jd)])  g  =  s,c.  (3.C.5b) 


Also, 


R  m - (p8ij)  g8»0gjjfg(>~gij’ - '  W-,.  if9  (h9  f0il) 

%(  )"  fftt  .  I  -lg..)l1=0  P  J  gij  )  gij(  )1) 


g  =  S,C 


(3.C.5c) 


Rgjj(l)  =  Pg|J  g"%  g(  g‘J’ - ^exp(-j[eg  (-1)]}  g  =  s,c.  (3.C.5d) 

_ fg(kgjj» 1  “  'gjj^kO _ 

The  last  four  equations  provide  us  with  a  useful  description  of  the  cross¬ 
correlation  function  in  terms  of  the  cross-correlation  coefficient  pg.j,  the 

standard  deviations  Ojj  and  ojj  of  the  channel  i  and  j  processes,  respectively,  and 
the  temporal  cross-correlation  coefficient,  Xg.j. 


For  the  autocorrelation  function  (i—j),  we  have 


(3.C.6a) 


since  any  given  channel  process  is  totally  correlated  with  itself  at  zero  lag.  Also, 


egii(°)  =  0  (3.C.6b) 

since  0g..(l)  is  an  odd  function  of  I  (see  section  III.E.l.a).  Eq(3.C.5b)  for  the 

autocorrelation  function  now  becomes 

°giifg^gii’  ^ 

Rgii(,)  *  7T - “j  exp{j[9gii(,)] }  (3.C.7) 

igCA-gii*  I  /  1—0 
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where  we  again  note  that  lg.j=0  for  i=j  since  the  autocorrelation  function  peaks  at 
lag  zero.  Furthermore,  since  the  function  fg(*)  for  the  autocorrelation  function 
has  a  peak  value  of  unity  at  1=0,  eq.(3.C.7)  reduces  to 


g=s,c. 


At  I  =  0,  eq.(3.C.8)  becomes 
Rgii(°) =  agii 


g=s,c 


(3.C.8) 

(3.C.9) 


(3.C.10a) 


which  is,  as  expected,  the  variance  of  the  zero  mean,  channel  i  process.  Finally, 
we  also  point  out  that  since  Kg„  in  eq(3.C.3)  is  a  real  constant,  then,  defining 

K«..  as 
Sij 

Kgij  =  Kgij  fg^gij’ 1 '  ’gij^l=0 
eq(3.C.3)  enables  us  to  obtain 

Kgij  ~  Gij  exP  ( ~j0gjj(°) } 

=  (Pgij)°gii0gjjcxPt’j®gij^J* 

=  lpgijlogiiag]j 


(3.C.10b) 

(3.C.10c) 

(3.C.10d) 


where  eqs(3.C.10c)  and  (3.C.10d)  result  from  eqs(3.B.5)  and  (3.B.7b), 
respectively.  We  note  that  Kg.j  is  also  real,  although  Gy  and  pg„  are  in  general 


complex. 

In  the  above  discussion,  we  have  proposed  using  functional  forms  to 
characterize  the  magnitude  and  phase  of  the  correlation  functions.  The  motivation 
for  this  approach  is  that  it  allows  us  flexibility  in  modeling  random  processes 
with  various  correlation  and  spectral  shape.  We  caution,  however  that  at  this 
point  we  have  not  constrained  these  functions  to  meet  all  the  criteria  that  are 
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necessary  and  sufficient  to  characterize  correlation  functions.  In  fact,  determining 
all  of  these  conditions  in  a  general  formulation  is  a  difficult  task.  In  section 
III.C.4,  we  consider  several  constraint  conditions  including  the  important 
condition  of  positive  semi-definiteness  of  the  correlation  matrix.  In  that  section, 
we  show  that  even  for  correlation  matrices  of  small  dimension,  determination  of 
an  analytic  solution  of  the  constraint  conditions  is  tedious.  However,  empirical 
methods  to  control  the  parameters  can  be  utilized. 

2.  The  Autocorrelation  Function 

In  this  section,  we  consider  the  special  cases  of  the  Gaussian,  exponential 
and  sine  shaped  autocorrelation  functions  using  the  form  denoted  in  eq(3.C.8). 
a.  The  Gaussian  Shaped  Autocorrelation  Function 

In  this  special  case,  we  consider  autocorrelation  functions  with  Gaussian 
shaped  magnitudes  for  the  signal  and  clutter  processes  such  that  (dropping  the 
subscript  i  notation  for  convenience) 

fsas,l;  =  (xj  =  exp[-  2it2HjT2l2]  (3.C.1  la) 

and 

2  a 

fc<V>  =  o^.)1  =  exp[-  2ji2HjT2I2]  (3.C.llb) 

where 

X.g  =  exp[-27t2PgT2]  g  =  s,c  (3.C.12) 

and  Xg  is  a  real  constant  such  that  0  <  Xg  <  1  and  T  is  the  sample  period.  In 

2 

section  in.D,  we  show  that  p  with  g=s,c  is  the  variance  of  the  Gaussian  spectra 

© 
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associated  with  the  signal(g=s)  or  non-white  noise(g=c).  Using  these  equations  in 
eq(3.C.8)  provides 

Rs(l)  =  <£ f(XsJ)exp[jes(D]  =  Oj  (Xj)'2 exp[jes(l)]  l>0  (3.C.13a) 

and 

RcO)  =  a2c  f(^J)exp[j0c(l)]  =  o\  (kj1  exp[jec(l)]  l>0.  (3.C.13b) 

Using  eq(3.C.13b)  in  (3.A.13a)  for  i=j,  we  obtain 

Rd(D  =  °c  (*c)'2 exp|j0c(l)]  +  cl  5(1)  I  >0  (3.C.13c) 

where  d  denotes  the  entire  disturbance  process  consisting  of  non-white  plus  white 

noise  and  the  white  noise  autocorrelation  function  has  been  expressed  in  terms  of 
the  Kronecker  delta  function,  6(1).  Eqs(3.C.13a)  and  (3.C.13b)  indicate  that  Xg  is 

a  measure  of  the  correlation  magnitude  between  consecutive  samples  [2]  of  the 
process  on  channel  i.  This  is  determined  by  considering  that  the  magnitude  of 

Rg(l)  at  I  ss  1  is  decreased  by  the  factor  Xg  as  compared  to  the  magnitude  at  I  =  0; 
ie. 

lRg(l)l  =  X.g  Rg(0).  (3.C.14) 

♦ 

The  relationship  Rg(-I)  =  [Rg(l>]  where  g=s,c  provides  the  appropriate 

value  of  the  autocorrelation  function  at  negative  lag  values, 
b.  The  Exponential  Shaped  Autocorrelation  Function 

In  the  case  of  the  exponential  shaped  autocorrelation  function,  we  have 

fs(M  =  (^s)1'1  (3.C.15a) 

and 
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(3.C.15b) 


fcO-c.l)  =  O-c)"1 

And  so,  eqs(3.C.8)  and  (3.A.13a)  enable  us  to  obtain 


Rs(l)  =  (X,)111  exp[j0s(l)]  (3.C.  1 6a) 

and 

Rd(D  =  (Xc)hl  exp09c(l)]  +  al  8(1).  (3.C.16b) 


c.  The  Sine  Shaped  Autocorrelation  Function 

In  this  case,  the  shaping  function  for  the  autocorrelation  function  is 
expressed  as 


sin[2jt(l-^s)l] 
fs(M=  [271(1-^)11 


(3.C.16c) 


so  that 

2  sin[27t(l-^s)l] 

RS(D  =  <?s . [2n(Uk$}'~  exP^9s(1>^  (3.C.16d) 


d.  Normalization  by  the  White  Noise  Variance 

If  the  expressions  in  the  first  equality  of  eqs(3.C.13a)  and  (3.C.13c)  are 
normalized  by  the  white  noise  variance  we  have 
Rs(l) 

rs(l)  =  =  (SNR)fs(Xs,l)  expU0s(l)]  (3.C.17a) 


and 


RdO) 

rd(l)  -  "V  =  (CNR)fc(A.c,l)  exp[j0c(l)]  +  5(1) 


'w 


(3.C.17b) 


where 
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SNR  =  <*s  /  °w  (3.C.18a) 

and 

CNR  =  a^/a^.  (3.C.18b) 

Eqs.(3.C.17a)  and  (3.C.17b)  are  equivalent  to  those  suggested  in  [2]. 
e.  Polar  F.onii-wilh-a.P<?ppler  Shift 

The  expression  for  the  correlation  functions  can  be  modified  using  a  linear 
phase  shift  term  to  explicitly  account  for  a  Doppler  center  frequency.  In  this  case, 
eqs.(3.C.13a)  and  (3.C.13c)  can  be  expressed  as 

Rs(l)  =  fs(\.  I)exp[j0s(l)]exp[j2jtfsl  T]  (3.C.19a) 

and 

Rd(D  =  ^fc(\.,l)exp[j0c(l)]expU2)tfcl  T)  +  c*  5(1)  (3.C.  1 9b) 

where  fs  and  fc  are  the  signal  and  clutter  Doppler  center  frequencies, 
respectively. 

3.  The  Cross-Correlation  Function 

We  will  now  consider  the  special  cases  of  Gaussian,  exponential  and  sine 
shaped  cross-correlation  functions.  In  section  III.C.4,  constraint  equations  "dll  be 
developed  in  order  to  control  the  positive  semi-definiteness  of  the  appropriate 
correlation  matrices. 
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a.  Gaussian  Shaped  Cross-Correlation  Function 

In  this  special  case,  we  consider  cross-correlation  functions  with  Gaussian 
shaped  magnitudes  for  the  signal  and  non- white  noise  processes  using  eqs(3.C.5a). 
Consider  the  functional  form 

\2 


fg^gij’  ,_lgij)  ”  ^gij^'W  g_s,c 


(3.C.20) 


where  (see  section  III.D) 

Xg..  =  exp[-  2ic2jigijT2]  (3.0.21 ) 

and  0  <  X  g„<  1.  Using  eq(3.C.20),  the  normalizing  terms  in  the  denominators 

of  eqs(3.C.5)  become 

fg^gij’  *’*gij^|=o  =  ^gjj^gij  g=s»c-  (3.C.22) 

Using  eqs(3.C.20)  and  (3.C.22)  in  eqs(3.C.5a)  and  (3.C.5b),  we  obtain 

2 

(Pgi  )<JgjjCTgjj(^g::)^  *gij^ 

Rgij(|) =  J  2  - exp  ( j  COgjj  (»)-Ogij  (0)] } 

(Xgij)'gij 


g  =  S,C 


(3.C.23a) 


r 

lpgiilqgiiqgii(X'gii)(l~lgij) 


^gij^gij 


^xp{j0g.j(l)} 


g  =  S,c. 


(3.C.23b) 


Also 


v>= 


r 

(Pgji^gi^gij^gjp^'^jP 


(Xgji)!gj» 


^p  { jtegjjCD-egjjCO)] } 


g  =  S,c 


(3.C.23c) 
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g  =  S,c. 


(3.C.23d) 


Eq(3.C.23a)  implies  that  Xg.j  is  a  measure  of  the  correlation  magnitude  between 
consecutive  samples  (but  delayed  by  lag  lg„)  across  channels  i  and  j.  This  is 
determined  by  noting  that  lRg.j(l)l  decreases  by  the  factor  X,g.j  at  I  =  lg„  ±  1  as 


compared  to  the  magnitude  value  at  I  =  Ig^;  ie. 

^Sij^gij ±  ^  =  ^8ij  ^gi/'gij^* 


(3.C.24) 


Examination  of  eq(3.C.23a)  indicates  that  at  I  =  0,  we  obtain  the  desired 
result  that  Rg.j(O)  =  (Pgjj)°gjjagjj*  We  also  note  that  at  I  =  lg„ 

(Pgij)^gii^g*- 

RgjjOgjj)  = - J - 2  ^  exP ( j [0gij(|gij)'0gij(°)l >  (3.C.25a) 


^gij^gij 

lpgijlagiiqgj 

^gij^gij 


exp{j0gij(,gij)} 


(3.C.25b) 


Eq(3.C.25b)  indicates  that  as  Xg.j  approaches  zero,  the  correlation  function 
would  increase  significantly  if  Ipg  J  were  not  controlled.  In  section  m.C.4,  we 

,2 

will  show  that  we  must  at  least  restrict  Ipg  J  such  that  Ipg  J  <  (^gjj)gij  in  order 

to  satisfy  one  condition  of  cross-correlation  functions.  However,  we  will  also 
show  that  this  condition  is  necessary,  but  not  sufficient,  to  properly  shape  the 
cross-correlation  function. 

We  now  consider  that  from  eqs(3.A.4)  and  (3.C.23a) 
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(3.C.26a) 


^Pgip  0gii°gji^gii)(,',’,Sij) 


^gij^gij 


5xP{-j[0gij(-i)-egij(O)] } 


g=s,c. 


We  can  now  show  that 


PSij  ~Pgji 

Ift •  .  “ 

Slj  Sji 

Xn..  “ 

Sij  Sji 

W^-V*0 


g  =  S,c. 


Proof 


(3.C.26b) 


(3.C.27a) 

(3.C.27b) 

(3.C.27c) 

(3.C.27d) 


Eq.(3.C.27d)  was  proven  in  eq.(3.B.ll).  From  eq.(3.A.4),  we  have  at  1=0, 


Rg..(°)  =  [Rgj.(0)]  . 


(3.C.28) 


Using  eqs.(3.C.23a)  and  (3.C.23c)  in  eq(3.C.28),  the  equality  in  eq(3.C.27a) 
follows  directly.  We  now  consider  the  absolute  values 


lRa;:(l)l  = 


lpgij,2°gii°gjj(X,gij)2(l  W 

a,,,)*1-/ 


(3.C.29a) 
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Ipgij|2agu°gjj^gjp2(l+Igji) 


(3.C.29b) 


^  vv 

where  we  have  used  the  equality,  lpg  J2  =  Ipgjjl2.  Using  the  equality  expressed  in 
eq(3.B.10),  we  now  obtain 


\2  <^/i .  i  ^2 


^gjj 

2  ~  2 

^gij^2*Sij  (^/gji 

Eq.(3.C.30)  must  be  satisfied  at  all  values  of  I.  At  I  =  L... 

gU 


while  at  I  =  -L.. 

gji 


(Xgij)2lgij 


21?.. 


g=s,c 


0(\  4.1  ^giP  giJ 

%)2(W - ]~T 


,,2 

(Xgjj)2gji 


g=s,c. 


(3.C.30) 


(3.C.31a) 


(3.C.31b) 


Noting  the  inverse  relationship  expressed  by  the  RHS  of  eqs.(3.C.31a)  and 
(3.C.31b),  we  have 

2  2 

(*-gij)2(gij+lgji)  =  (^gji)'2(lgij+  lgji)  •  (3.C.32) 


Since  0  <  Xgj.  <  1,  eq.(3.C.32)  can  only  be  satisfied  if 
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Using  eq.(3.C.33)  in  eq.(3.C.30),  it  follows  that 


Sij  Sji 


g=s,c. 


(3.C.34) 


b.  Exponential  Shaped  Cross-Correlation  Function 

In  the  case  of  cross-correlation  functions  with  an  exponentially  shaped 
magnitude,  we  have 


fg^gij’  ,_,gij)  =  (kgij)^  W  g“s»c 


where  0  <  <  1.  At  1=0,  we  have 

-  gij~ 


fg(X,gij’  ^gij^M)  “  (Xgij)l,giJl 
Using  these  results  in  eq.(3.C.5a),  we  have 


g=s,c. 


Jl-L-.l 


(Pgij)<^gii^g--(^gij)  gjj 

Rgjj(l)  =  — 1 - - exp{j[0g..(l)-egij(O)]) 

(Xgij)gij 


g  =  s,c. 


Again,  using  eq(3.A.4) 


ll+L.J 


Rgji(,)  =  — 1 J — “ -|--f  exp  { -j[eg.j(-i)-egij(0)] } 

(Xgij>  gij 


g  =  s,c. 


(3.C.35) 


(3.C.36) 


(3.C.37a) 


(3.C.37b) 


c.  The  Sine  Shaped  Cross-Correlation  Function 

In  this  case,  the  shaping  function  for  the  cross-correlation  function  is 
expressed  as 


fg[Xgij,  (l-'gjj)]  = 


sin[2jc(l-Xg..)ll  -  lg..l] 
[2it(l-Xgij)ll  -lgijl] 


g  =  S,c. 


At  I  *  0,  we  have 

|  sin[2n(l-Xg.j)lg.j] 

fglA.gij,(i-igij)Ji|=0-  [2n(l-Xg ..)lg ..]  g-s,c. 


so  that 


Rgij(')  = 


|"sin[2n(l-Xgij)ll  -  Igjjl] 

'Pg*'°gii<M.  w.-xgi.)li-igi|.l] 

'sin[27r(l-X.g..)lg..]~| 

[27t(l-X,g.j)lgy] 


exp[j0g.j(l)] 


(3.C.38) 


(3.C.39) 


g  =  s,c.  (3.C.40) 

d.  Multichannel  Doppler  Processes 

If  a  baseband  signal  gj(n)  on  channel  i  is  considered  to  have  a  Doppler 
center  frequency  fg.,  we  can  express  this  process  as 

gi(n)  =  {g|j(n)  +  jgjQ(n)  }exp[j27tfg.nT]  (3.C.41) 

where  T  is  the  pulse  repetition  period.  The  cross-correlation  function  is  therefore 


Rg.j(n,n-I)  =  E[gj(n)gj  (n-l)] 

=  E{  [gij(n)  +  jgiQ(n)] [gj!(n-I)  -  jgjQ(n-l)] } 

•  exp[j27rfg.nT]exp[-j27rfgj(n-l)T] 


(3.C.42a) 


(3.C.42b) 
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=  E{[gii(n)gjj(n-I)]  +  [giQ(n)gjQ(n-l)] 

+  j[giQ(n)gji(n-l)j  -  gil(n)gjQ(n-l)]} 

•  exp[j2jcfg.nT]exp[-j27cfgj(n-l)T].  (3.C.42c) 

For  joint-stationary  conditions  on  the  random  processes  contained  in  the 
expectation  operation, 


Rgij(n,n-I)  =  [R^yd)  +  jR|ij(l)]exp{j2n[(fgi-fgj)nT  +  fgjIT]). 


(3.C.43) 


We  note  that  this  cross-correlation  function  is  not  time  independent  for 
fgi^fgj  due  to  the  term  involving  the  frequency  difference  in  the  exponential. 


Thus,  the  processes  are  not  jointly  stationary.  This  situation  would  result,  for 
example,  when  processing  data  from  two  or  more  radar  systems  operating  at 
different  center  frequencies.  However,  since  the  time  dependent  term  is 
deterministic,  it  can  be  removed  in  the  pre-processing.  This  is  achieved  by 
selection  of  a  reference  channel  and  frequency  multiplying  the  other  channel 
signals  so  that  the  resulting  Dopplers  are  all  equal  to  that  of  the  reference.  The 
proper  mixing  terms  are  obtained  as  follows.  First,  consider  the  Doppler 
frequency  on  channel  i  expressed  as 


fgi“ 


2vf 


01 


(3.C.44) 


where  v  is  the  object  velocity,  f0j  is  the  channel  i  carrier  frequency  and  c  is  the 

velocity  of  light.  We  therefore  have  the  relation  between  channels  i  and  j,  such 
that 


^i_  j5i_2v 
*oi  *oj  c 


(3.C.45) 
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If  we  select  channel  i  as  the  reference  channel  so  that  fg.=  fg^  and  *oi  ~  ^OR 
where  fgR  is  the  Doppler  on  the  reference  channel  and  f0£  is  the  reference 


channel  carrier  frequency,  we  have 


fgR” 


r0R 


Lfoj 


% 


J  1»2,...,J. 


(3.C.46) 


And  so,  if  each  channel  j  is  frequency  multiplied  by  its  appropriate  factor 
(f0R/f0j),  all  of  the  Dopplers  will  be  equal  and  eq(3.C.43)  reduces  to 


Rgij(D  =  [Riyfl)  +jR|ij(l)]expU2jrfgRm- 


(3.C.47) 


This  result  depends  only  on  lag  I  and  therefore  satisfies  the  stationary  condition. 
The  preprocessing  proposed  here,  of  course,  would  be  performed  subsequent  to 
processing  stages  which  might  utilize  the  raw  Doppler  information  contained  on 
each  channel. 

The  corresponding  polar  functional  expression  for  eq(3.C.5a)  is 


IPg.  .^0  .  .fg(A.0.  .,1  “  lg..) 

Rgij(l)  =  fg(i  J .  lg.j)l|=0  "  eXP {j[e8ij(1)] ,exPCj2refgR|  T).  (3.C.48) 
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4.)  Constraint  Conditions  For  Correlation  Functions 

In  this  section,  we  discuss  the  constraints  that  must  be  imposed  on  the 
parameters  of  the  functional  forms  discussed  in  the  previous  sections  to  ensure 
that  these  functions  have  the  appropriate  form  for  correlation  functions.  These 
conditions  are  discussed  in  the  next  two  subsections.  In  III.4.a,  we  develop 
general  constraint  conditions  while  in  m.4.b,  the  condition  of  positive  semi- 
definite  correlation  matrices  is  considered.  As  noted  in  section  II,  the 
multichannel  correlation  matrix  is  Hermitian  and  positive  semi-definite  for 

stationary  processes.  The  expressions,  developed  in  eqs(3.C.5a)  through 
(3.C.5d),  are  contained  as  the  elements  of  the  multichannel  correlation  matrix, 

Rxx.  Therefore,  we  must  ensure  that  this  matrix,  when  using  elements  obtained 

from  these  equations,  satisfies  the  condition  of  positive  semi-definiteness;  ie.  a 
matrix  for  which  all  eigenvalues  are  non-negative  or  all  subminor  matrices  of 

Rxx  have  a  non-negative  determinant  [12,13].  These  conditions  will  impose 

2 

constraints  on  the  terms  Pg.j,  Xg.j,  A,g..,  Og..,  and  Ig-. 
a.  General  Constraint  Conditions 

Several  important  constraints  can  be  developed  in  a  straightforward 
manner  by  generalizing  a  discussion  noted  in  [5];  ie.,  with  the  real  constant  a,  we 
consider 


E[lxi(n+l)+axj(n)l  ]  =  E{[xi(n+l)+axj(n)][xj  (n+l)  +  axj  (n)]} 

*  4c 

=  E[xi(n+I)xj  (n+l)]+  aE[xj(n)xj  (n+l)] 

+  aE[xi(n+l)xj  (n)]  +  a2E[xj(n)xj  (n)] 


(3.C.49a) 


(3.C.49b) 
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(3.C.49c) 

(3.C.49d) 


=  Rii(O)  +a[Rji(-l)  +  Rjjffl]  +  a2Rjj(0) 

=  Rjj(0)  +a[Ry(l)  +  Rjj(l)]  +  a2Rjj(0) 

so  that 

E[lxi(n+l)+axj(n)l2]  =  Ri{(0)  +  2aRe{Rij(l)}  +  a2Rjj(0).  (3.C.49e) 

The  above  quadratic  is  nonnegative  for  any  a;  therefore,  its  discriminant  is 

nonpositive  so  that  from  eq(3.C.49e) 

[Re  {Ry(l)]2  <  Rjj(0)Rjj(0).  (3.C.50a) 

Likewise,  interchanging  i  and  j  in  eq.  (3.C.49a),  we  obtain 

[Re{Rji(l)]2  <  Rii(0)Rjj(0).  (3.C.50b) 

Since  the  geometric  mean  of  two  numbers  does  not  exceed  their  arithmetic  mean, 
we  also  have 

2lRe{Ry(l)}l  <  Rji(O)  +  Rjj(O)  (3.C.51a) 

and 

2lRe  { Rjj(l) }  I  <  Rh(0)  +  Rjj(O).  (3.C.5 1  b) 

Alternative  expressions  can  be  obtained  from  eq.(3.C.49c)  such  that 

[Rjj(l)  +  Rjj(-I)]2  <  4Rjj(0)Rjj(0)  (3.C.52a) 

and 

[Rji(l)  +  Rij(-I)]2  <  4Rii(0)Rjj(0).  (3.C.52b) 

We  will  now  consider  the  specific  example  of  the  Gaussian  cross- 
correlation  function  and  demonstrate  how  the  above  equations  are  utilized  to 
constrain  the  function  parameters.  Using  the  real  constant  defined  by  eq.(3.C.10c) 


in  eqs.(3.C.23a)  and  (3.C.26b),  we  obtain 

Kgii^gij^llgij^ 

Rgii(,)  =  2 —  expuegj.d)] 

(  ^gij^gij 


(3.C.53a) 
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Kgii(W(l+lgij^ 

Rgji(,)  =  — - L~2 - cxp[-j0g..(-l)]. 

(  ^gy)  gij 

Inserting  eqs(3.C.53a)  and  (3.C.53b)  in  constraint  eq(3.C.52a) 


(3.C.53b) 


Kgii(A,gii)(l’lgij)2 


- 1 -  2 -  expUGg  (I)] 

_  < ^gij^gij 

Kgii(^gii)(  ^£ij^  2  2 

+ - - J — ; -  exp[-j0B..(l)]  <  4 ow..o_... 

r  gy  -  gn  gjj 

(  Arjj)  gij 

Noting  that  (-1  +  Ig.^)^  =  (1  -  Ig.^,  we  have 


4(Kgii)2(Xg..)2(|-|gij)2 


<*»/«« 


os2[0g..(l)]  <  4c^..a^. 
gy  gn  gjj 


so  that  from  eq(3.C.IOd), 

lpgii|2^gip2^  lgij^ 


-  2 - cos2[0g..(l)]  <  1. 

(X,gij)2lgij 


(3.C.54) 


(3.C.55a) 


(3.C.55b) 


The  most  stringent  condition  for  this  constraint  equation  occurs  when  I  =  lg„ ,  so 


<^gii>2l8ij 

Pgij  -  cos2[0gij(lgij)j' 


(3.C.56a) 


Taking  the  positive  square  root  of  both  sides  of  this  equation,  we  have  the 


constraint 


IPe -I  <T - J - f  • 

1J  icOSCQg.jdgy)]! 


(3.C.56b) 


The  result  expressed  by  eq(3.C.56b)  provides  a  constraint  for  Ipg  J  which 

is  upper  bound.  It  represents  one  of  several  conditions  that  must  be  satisfied  by 
complex  correlation  functions. 


Although  the  constraint  procedure  presented  above  is  utilized  in  order  to 
bound  the  constant  parameters  to  those  values  which  will  provide  the  proper 
form  of  correlation  matrices,  it  should  be  noted  that  they  are  necessary,  but  not 
sufficient  conditions.  In  the  next  section,  we  will  discuss  the  constraint  of  positive 
semi-definite  correlation  matrices  and  show  that  they  lead  to  additional  constraint 
conditions  which  are  also  not  in  themselves  sufficient. 


b.  Conditions  for  Positive  Semi-Definiteness 

In  this  section,  we  consider  conditions  for  positive  semi-definiteness  of  the 
correlation  matrix  described  in  eq(2.5).  By  considering  a  specific  example  of 
this  correlation  matrix,  it  is  shown  that  additional  relationships  exist  among  the 
parameters  leading  to  further  constraint  equations.  However,  as  we  will  show, 
with  appropriate  adjustment  of  the  parameters,  positive  semi-definiteness  can  be 
achieved.  The  principal  motivation  for  satisfying  this  constraint  is  two-fold. 
First,  we  are  further  restricting  these  arbitrary  functional  forms  to  conform  to 
the  proper  shapes  of  correlation  functions.  Second,  we  are  satisfying  a  condition 
for  physical  realizability.  In  section  V,  we  discuss  a  method  for  the  synthesis  of 
multichannel  AR  processes  which  insures  that  the  positive  semi-definiteness 
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constraint  is  maintained.  The  most  direct  method,  however,  would  be  a 
determination  of  the  eigenvalues  through  a  singular  value  decomposition  (SVD). 
EXAMPLE 

In  this  example,  a  4x4  correlation  matrix  Rxx  for  a  two  channel  process 

will  be  considered.  The  Gaussian  shaped  distribution  will  be  used  for  both  the 
auto-  and  cross-  correlation  functions  so  that  (dropping  the  g=s,c  notation) 

RkkO)  =  <»kk  (W2  exP(j&kk(l)l  k  =  i  j  (3.C.57a) 


Rjjd)  = 


|pijlCTiiCTjj(^ii)(|-|ij)‘ 


,2 


»p[j0ij(O] 


(3.C.57b) 


Rji(l)  =  1J  1  JL^—  J-exp[-jeij(-l)]. 


(3.C.57C) 


Using  these  relations  in  the  4x4  correlation  matrix  and  simplifying  for  rgal 

correlation  functions,  we  have 

“RU(0)  R12(0)  Rn(l)Ri2(l)“ 

R2i(0)  R22(°)  R2l(l)R22(1) 

Rtt  ~  n  /  i  \  n  /  i  \  r»  _  /n\  n  .  (3.C.58a) 


Rii"  Rn(-l)Ri2(-l)Rll(0)Ri2(0) 
.R2i(-1)  R22(-D  B2l(0)  *22(0) 


lp12,0ll°22 


|Pl2IOU°22 
2  , 

^l^ll 

iPl2  ^®ii®22  ^12^  ^ 


2  , 

®11  ll 


|Pl2lOii022(Xi2)1+2,12 


|Pl2IOU°22(A'12)  1-2112 


Ipl2  ^®11®22  ^12*  12 

2  . 

°22*22 


2  4 

°22K22 


lPl2l°Xl°22 


|Pl2lall°22 


(3.C.58b) 
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As  noted  above,  all  subminor  matrices  must  be  non-negative  for  positive 
semi-definiteness.  In  this  section,  we  will  consider  a  few  of  the  required 
constraint  equations  by  requiring  the  determinants  of  die  four  principal  minors  in 
eq(3.C.58b)  to  be  positive.  After  considerable  algebraic  manipulation  of  these 
determinants,  we  obtain  the  inequalities 

>0  (3.C.59a) 

all°22[1  "  I  Pl2  I  2  3  >0  (3.C.59b) 

a22a22^  “  <Ml>2  “  A1 1  Pl2  I  2  >  (3.C.59c) 

°lla22^  C"  A2 1 P 1 2  I  2  +  B  I P12  I  4  }  (3.C.59d) 


where 


Aj  =  1  +  Kj  -  2(X-i !)K! 


Ki  = 


(>■12) 


(l-2li2)2 


X 


(>■12)12 

A2  =  2  +  [Kj+Kj]  -  2au+X22)[K1+K2] 


K2  = 


+  2(XUXX22)(1+(>.12)2] 

(Xi,)<1+2I12)2 

(Xl2)  ,  =(X12)^2I12 

(A.i2)'i2 


b  =  1  -  2  (knr  +  (M2)4 
C  =  (M 1)2  +  (M2)2  -  (M  i)2(M2)2- 


(3.C.60a) 


(3.C.60b) 


(3.C.60c) 

(3.C.60d) 

(3.C.60e) 

(3.C.60f) 


2 

Eqs(3.C.59a)  and  (3.C.59b)  are  always  satisfied  since  is  positive  and 
2 

Ip  1 2 1  ^  1*  In  Appendix  E,  we  show  that 


Al>l-(Xli)2>0 

(3.C.61a) 

0  <  B  <  1 

(3.C.61b) 

0  <  C  <  1. 

(3.C.61c) 

Since  qj  and  022  are  also  positive,  then  eq(3.C.59c)  is  satisfied  when 

.  .-)  1  -  <Mi>2 

'P12'2^  Al  • 

(3.C.62) 

Using  eq(3.C.61a)  in  eq(3.C.62),  we  note  that  the  condition 

I  p12l2  <  1  is 

maintained.  Eq(3.C.56d)  is  satisfied  when 
A2lpi2l2-Blpi2l4<l-C 

(3.C.64a) 

or 

lp12l2  [A2  -  Blp12|2]  <  1  -  C. 

(3.C.64b) 

Eq(3.C.64a)  can  also  be  expressed  as 

Blp12l4-A2lp12|2  +  (1  -C)>  0. 

(3.C.64c) 

Since  this  quadratic  is  non-negative  for  any  Ipi2^»  its  discriminant  is  non¬ 
positive  so  that 

(A2)2  <  4B(1-C).  (3.C.64d) 

The  inequalities  in  eqs(3.C.62)  and  (3.C.64a)  through  (3.C.64c)  can  always  be 
achieved  for  sufficiently  small  values  of  I P 1 2  I  *  be  an  important 

control  parameter  in  the  process  synthesis  procedure.  We  now  consider  several 
examples  using  the  above  constraints. 

CASEJ 

In  this  case,  we  consider  the  parameters  ^12  =  ^1 1  =  ^22  ^  1 12^  so  that 
from  eqs(3.C.60a)  through  (3.C.60f) 

Ki=K2  =  X12  =  A.11  (3.C.65a) 
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Al  =  l-(Xn)2  (3.C.65b) 

B  =  1  -  2(Xj !  )2  +  (Xi  i  )4  (3.C.65c) 

A2  =  2  +  2(XU)2  -  8(Xn)2  +  2(XU)2[1  +  (Xn)2] 

=  2[l-2(Xn)2  +  (Xu)4] 

=  2B  (3.C.65d) 

C  =  2(XU)2  -  (X!  i)4.  (3.C.65e) 

In  this  case,  eq(3.C.62)  is  always  satisfied  since  it  reduces  to 

lp12l<l  (3.C.66) 

while  eq(3.C.64a)  becomes 

2Blp12l2  -  Blp12l4  <  1  -  2(Xn)2  +  (Xu)4  =  B  (3.C.67) 

so  that 

2\p1jf2-\pn1i<l.  (3.C.68) 


This  equation  is  also  satisfied  for  Ip i2l  <  I  so  that  the  constraint  equations 
dicussed  here  are  satisfied  for  all  values  of  lpi2l.  This  condition  is  observed  in 

Table  3.1  which  shows  the  values  of  the  4x4,  3x3  and  2x2  principal  minor 
determinants  of  eq(3.C.58b),  respectively.  In  the  special  case  where  lp|2l=l  and 

°1  l=a22’  b°th  P1"00®88®8  become  identical.  In  particular,  when  ^i2=^l  l=^22  ~ 

0,  we  have  the  case  of  two  identical  white  noise  processes. 

CASE  2 

We  first  note  in  [2]  of  Table  3.1  that  when  ^ii=^22=1’  but  ^12^1*  even  the 

small  value  of  Ip  1 21=0-0001  causes  the  determinant  D4  to  go  negative.  In  this 

case,  we  make  a  small  reduction  in  the  temporal  correlation  coefficients  from 
unity  and  observe  the  effect  on  the  range  of  permissable  values  of  Xn.  Consider 

A.n=  %22  ~  0-95,  lpj2l  =  0.0001  and  lj2  =  2.  From  eq(3.C.60f),  C  =  0.99049  so 
that  eqs(3.C.62)  and  (3.C.64a)  become,  respectively 
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and 


lp12l2  <  0.0975/A ! 

A2IP12|2  -  biP12|4  ^  9.506x  l0'3- 


(3.C.69) 


(3.C.70) 


Using  Ipi2^  *  1x10“®  and  eq(3.C.60a)  in  (3.C.69),  we  obtain 
2  0975  /r 

A!  =  1  +  Kj  -  2(.95)Kj  <  ^ '  g  =  9.75x10°.  (3.C.71) 

Since  Kj  =  (A  12)^’  then,  solving  for  /-2  2  yields 

(X12r6  -  2(.95)(A.12)-3  -  (A-12)'6  <  9.75x10®  (3.C.72) 

or 

(3.12)6>10256x10-7  (3.C.73) 

so  that 

(Xi2)>  0.0685.  (3.C.74) 

This  result  agrees  with  the  3x3  determinant  D3  of  eq(3.C.58b)  in  [3]  of  Table 
3.1;  ie.,  D3  goes  negative  for  A,j2<0.0685.  The  more  stringent  condition, 
however,  is  expressed  by  eq(3.C.70).  For  2<0.3,  A2  ~(^-12)-^  ^  IP12*4  ~  0 

so  that  eq(3.C.70)  can  be  approximated  as 


(A.12)-6  Ipi2*2  <  9.506x  IO-3 

(3.C.75a) 

or 

(kl2)6  >  1.05196x10"^ 

(3.C.75b) 

so  that 

Xn  >  0.1008479 

(3.C.75c) 

which  agrees  with  the  value  where  D4  in  [3]  goes  negative. 
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The  significant  result  of  this  case,  however,  is  observed  by  first  noting  that  from 
eq(3.C.75),  we  have 

lp12l  <  .0975(X12)3.  (3.C.76) 

We  note,  however,  that  from  the  previously  developed  constraint  eq(3.C.56b) 
with  1 1 2  =  2,  we  have  the  inequality 

Ipl2'  ^  0-12)4-  (3.C.77) 

Therefore,  when  X\2  <  .0975,  eq(3.C.77)  is  more  restrictive  than  eq(3.C.76). 
However,  when  X\2  >  .0975  eq  (3.C.76)  is  the  more  stringent  condition.  This 

case  illustrates  that  neither  constraint  is  sufficient  to  guarantee  that  the  functionals 
will  have  the  proper  form  for  correlation  functions.  In  the  absence  of  such  a 
sufficient  condition,  the  proceedure  will  be  to  utilize  the  more  stringent 
condition;  ie.,  positive  definiteness  or  eq(3.C.53b)  recognizing,  of  course,  that 
either  of  these  two  conditions  may  not  be  sufficient.  As  noted  previously,  an 
SVD  method  appears  to  be  an  efficient  means  to  check  positive  semi-definiteness. 
A  recent  correspondence  on  this  topic  appears  in  [13]. 

This  case  also  illustrates  that  as  the  individual  channel  processes  each 

become  more  uncorrelated(ie.,  more  whitened),  they  can  also  become  less 
correlated  with  each  other  as  noted  by  the  small  value  of  X\2-  It  is  significant  to 

note  that  although  \  and  X22  were  lowered  by  a  relatively  small  amount(ie., 
from  unity  to  0.95),  the  value  of  A,  12  could  be  lowered  significantly,  provided 
Ip  12^  is  low.  Examination  of  [3]  and  [5]  in  Table  3.1,  however,  also  indicates  that 
the  lower  bound  on  \\2  is  highly  dependent  upon  Ip  1 2^* 
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\pn\ 

*11 

h.2 

X12 

d4 

d3 

d2 

!12 

0.0 

1.0 

1.0 

1.0 

0 

0 

36.0 

2.0 

0.1 

0 

0 

35.6 

0 

0.5 

0 

0 

27.0 

0.9 

0 

0 

6.8 

1.0 

0 

0 

0.0 

m 

0.0 

1.0 

1.0 

0.99 

0 

0 

36.0 

0.0001 

-1.0x10® 

0 

36.0 

0.0001 

0.95 

0.95 

0.90 

12.32 

31.59 

36.0 

0.20 

12.12 

31.54 

0.11 

5.04 

29.7 

0.10 

-0.59 

28.35 

0.070 

-97.6 

4.07 

0.069 

-107.6 

1.59 

KjkSh 

-118.6 

-1.16 

0.0001 

0.90 

0.90 

0.999 

46.79 

61.56 

0.30 

46.77 

61.55 

a 

0.10 

33.87 

58.33 

0.09 

22.46 

55.47 

0.08 

-2.56 

49.21 

0.07 

-64.24 

34.04 

0.06 

-230.7 

-7.85 

Table  3.1  Computed  values  for  the  principal  minor  determinants  of  the 
4x4  correlation  matrix  Rxx. 
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\pl2\ 

hi 

h.2 

X12 

d4 

d3 

d2 

!12 

0.9 

0.95 

0.95 

0.990 

1.59 

4.30 

6.83 

2.0 

0.980 

0.92 

2.68 

a 

0.970 

0.083 

0.43 

0.969 

0.0003 

0.169 

KUSH 

film 

0.9 

0.9 

0.9 

0.970 

1.149 

1.647 

a 

0.966 

0.135 

-0.131 

0.001 

0.1 

0.1 

1.0 

1270.2 

320.7 

0 

0.50 

220.4 

174.9 

0.54 

45.7 

150.6 

''BURS 

4  144.3 

a 

0.0 

0.0 

1.0 

Table  3.1  (contin.) 
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D.  Spectra  for  Complex  Correlation  Functions 
1.  General  Relationships 

The  power  spectral  density  Pjj(f)  of  the  continuous  random  process  xj(t)  is 


defined  as  the  Fourier  transform  of  its  autocorrelation  function  such  that 


pii(f)  *  jRji(T)exp(-j2jcfT)dx 


(3.D.1) 


while  for  the  discrete  processes  x(n),  we  use  the  discrete  Fourier  transform 


Pii(f)  =  T  ^RU(l)exp(-j2jcftT) 

|=-oo 


(3.D.2) 


where  Pji(f)  is  assumed  to  be  bandlimited  to  ±  2  T  Hz,  and  is  periodic  in 
•  frequency  with  period  ^  Hz. 

The  cross-power  spectrum  P|j(f)  of  two  processes  xj(* )  and  xj(  • )  is 
similarly  expressed  in  terms  of  the  cross-correlation  functions  such  that  for 


continuous  processes 

OO 

Pjj(f)  =  jRy(x)exp(-j2jrfT)dx 

-OO 

while  for  the  discrete  processes 

00 

Pij(f)  =  T  £Rij(l)exp(-j2itflT). 

lss-00 

Using  the  continuous  time  version  of  eq  (3.A.8);  i.e. 
Rii(t)  =  R*i(-x) 

in  eq  (3.D.1),  we  have 


(3.D.3) 


(3.D.4) 


(3.D.5) 


Pii(f)  =  |Rii(-x)exp(-j27cfx)dx 


(3.D.6a) 
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oo 


=  |Rii(x)exp(j2icfx)dT=  [Pii(f)]*  (3.D.6b) 

-oo 

where  the  last  equality  results  by  changing  the  variable  x  to  -x  and  appropriately 
changing  the  direction  of  the  integration.  Similarly,  using  eq  (3.D.5)  in  eq 
(3.D.2)  provides  the  discrete  time  version  as 

OO 

Pii(f)  =  T  ^^Rii(-l)exp(-j2jrflT)  (3.D.7a) 

l=-oo 

OO 

=  T  y  R*j(l)exp(4-j2nflD  =  [Pjj(f)]*.  (3.D.7b) 

|s-oo 

Equations  (3.D.6b)  and  (3.D.7b)  indicate  that  the  autospectra  are  real.  Since,  in 
general 


Rij(0  *  Ry(-I)  (3.D.8a) 

and 

Rij(x)  *  Rjj(-x)  (3.D.8b) 

the  cross-spectra  is,  in  general,  complex.  From  the  Fourier  inversion  formula, 
we  have 

oo 

Rii(x)  =  JPii(f)exp(j27tfx)df  (3.D.9a) 

.OO 

and 

oo 

Rij(x)  =  JPij(f)exp(j2jrfx)df  (3.D.9b) 

-oo 
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for  continuous  time  processes;  the  inverse  discrete  time  Fourier  transform  yields 
IT 

Rii(l)  =  fPji(f)exp(j27cflT)df  (3.D.10a) 

X 

" IT 
and 

X 

IT 

RijO)=  JPij(f)exp(j27rflT)df.  (3.D.10b) 

X 

"2T 

At  x  =  0,  eqs  (3.D.9a)  and  (3.D.9b)  become 

oo 

Rii(0)  =  JPii(f)df  (3.D.Ua) 

— OO 


and 


Rij(°)  =  JPjjWdf  (3.D.llb) 

.OO 

for  continuous  time  processes;  for  1=0,  eqs  (3.D.10a)  and  (3.D.10b)  become 
2T 

Rii(0)  =  fPjj(f)df  (3.D.12a) 

x 

"2T 

and 

X 

IT 

Rjj(0)  =  JPjj(f)df  (3.D.  1 2b) 

"2T 

for  discerte  time  processes. 
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2.  Quadrature  Component  Form 

We  now  consider  the  continuous  complex  autocorrelation  function  in  terms 
of  its  quadrature  components,  such  that 


Rii(t)  =  Ra„(t) + jRBjjW- 


(3.D.13) 


Using  eq  (3.D.13)  in  eq  (3.D.1),  we  have 

oo  oo 

Pii(f)  =  jRAii(T)exp(-j2jtfx)dx  +  j  jRBii(T)exp(-j2jcfr)dx.  (3.D.  14) 


But  since  RA^(x)  is  even  and  Rb~(x)  is  °dd  (see  section  m.E.l.a),  eq  (3.D.14) 


becomes 


OO 


OO 


Pii(f>  =  JR^  .(x)cos(2rcfx)dx  +  JrB;  .(x)sin(2rcfx)dx 


-OO 


-oo 


=  +  pBiiCO 


(3.D.15a) 

(3.D.15b) 
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Eq(3.D.15b)  indicates  that  the  autospectrum  is  real,  as  noted  previously. 

Since  the  first  integral  is  an  even  function  and  the  second  is  odd,  the  resulting 

summation  will,  in  general,  distort  the  spectrum  about  f=0  as  shown  in 
Fig.(3.D.l).  In  the  case  where  Pg..(f)  =  0.  the  spectrum  is  even.  This  results 

when  Rb..(t)=0,  so  that  Rjj(x)  is  real. 

3.  Spectral  Distribution  Using  the  Functional  Shaping  Method 

We  now  present  a  discussion  which  will  help  to  clarify  the  role  of  the 
temporal  correlation  coefficient  Xjj  introduced  in  section  HI.C  to  shape  the 

autocorrelation  function. 

a.  Spectrum  of  the  Gaussian  Shaped  Autocorrelation  Function 

In  this  case,  we  consider  a  real  autocorrelation  function  for  a  continuous¬ 
time  process  on  channel  i.  The  form  of  equation  (3.C.lla)  together  with  that  of 

eq(3.C.12)  is  used  with  the  subscript  notation  g  dropped.  Specifically, 

eii(T)  =  0  (3.D.16a) 

and 

2  2 

f(^ii»x)  =  X?.  =  exp  (3.D.16b) 

where 

Xjj  =  exp(-2rc2pjp.  (3.D.17) 

With  these  expressions 

2  2 

Rii(x)  =  os..exp(-27t2piiT2)  (3.D.  1 8) 
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is  a  real,  Gaussian  shaped  autocorrelation  function.  Taking  the  derivative  of 
eq(3.D.l)  with  respect  to  f  and  eq(3.D.9a)  with  repect  to  t,  we  have 


OO 


Pii(f)  =  J[-j27tTRii(T)]exp(-j2«fT)dT 

•OO 

(3.D.19a) 

and 

OO 

Rii(t)  =  J  [j27ifPii(f)]exp(+j27tfT)df. 

•OO 

(3.D.19b) 

Therefore, 

-j2itxRii(t) 

(3.D.20a) 

and 

Rii(x)  j2jtfPji(f) 

(3.D.20b) 

F  T 

where  ^  denotes  the  Fourier  transform  pair. 

Taking  the  derivative  of 

eq(3.D.18)  with  respect  to  t 

Rii(x)  =  -  4rc2  Rii(x) 

(3.D.21) 

so  that  from  eq.  (3.D.20b) 

j2rcfPii(f)  t  Rii(T). 

(3.D.22) 

2 

Dividing  both  sides  of  (3.D.22)  by  -}2n\L^  yields 

-  pa®  -j2nxRii(t)- 

Pii 

(3.D.23) 

Using  eq.  (3.D.20a)  and  eq.(3.D.23) 


Solving  this  equation  for  Pjj(f),  we  obtain 


(3.D.24) 


Pii(0  =  Plj(0)exp(-  f2/2n?j)  (3.D.25) 

2 

where  it  is  now  observed  that  jj.-  is  the  variance  of  the  Gaussian  power  spectral 

density  function.  Eq(3.D.25)  indicates  that  the  real,  Gaussian  autocorrelation 
function  results  in  a  symmetric,  Gaussian  power  spectral  density  (PSD). 

For  the  discrete  time  case,  T— »IT  where  T  is  the  sample  period,  so  that 

Rij(l)  =  Cs..exp(-2n24T2l2)  (3.D.26a) 

=  o?..x!2  (3.D.26b) 

Su  11 

and  the  last  equation  results  from  eq(3.D.17).  Also,  from  eq(3.D.17),  we  see  that 
as  the  variance  of  the  power  spectrum  p?  ranges  from  zero  to  infinity,  Xu  goes 

from  one  to  zero,  repectively.  Figure  3.D.2  shows  the  functional  plot  of  Rjj(l) 
and  Pji(f)  for  0<Xjj<l.  For  =  0,  Rj^l)  is  a  delta  function  8(1)  and  Pjj(f)  is  a 
white  noise  spectrum.  When  =  1,  Rjj(l)  denotes  the  case  of  total  temporal 
correlation  with  a  line  spectrum  for  Pjj(f).  For  Xjj  ranging  from  zero  to  unity, 
all  values  of  temporal  correlation  are  obtained.  Thus,  Xjj  is  a  measure  of  the 

temporal  correlation  between  consecutive  samples  of  the  random  processes  [2]. 
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b.  Spectrum  of  the  Exponential  Shaped  Autocorrelation  Function 

In  this  section,  we  consider  a  real  exponential  autocorrelation  function  for 
a  continuous  time  process  on  channel  i.  For  this  case,  we  have 

8ii(T)  =  0  (3.D.27a) 

f(Xu,T)  =  x|iT  1  =  exp(-2jryjj  |tl)  (3.D.27b) 

where 

Xjj  =  exp(-2jCYjj).  (3.D.28) 

With  these  expressions,  we  have 

RiiCO  =  Og  .jexpC^Tryii  I  x  | )  (3.D.29) 

The  power  spectral  density  is  determined  by  considering  Rjj(x)  as  the 
superposition  of  two  functions  such  that 

Rii(x)  =  axJu(T)  +  OsjjX^uC-T)  (3.D.30) 


where  u(x)  is  the  unit  step  function.  And  so,  the  power  spectral  density  is 
expressed  as 


Pii(f)  =  Ja^..exp(-27rYiiX)exp(j27cfx)dx 
0 


w 

Jog..exp(-27ryijX)exp(j2jTfx)dT 


(3.D.31a) 


-oo 


2 

°sii 


Sii 


(2jtYii)  +  K2*f)  (27CYii)  -  j(27cf) 


(3.D.31b) 
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2<JSii(2irYii) 

(2jtyjj)2  +  (2rcf)^  ' 

The  peak  value  of  this  function  occurs  at  f=0  so  that 

2 

Pii(°)  =  S- 

Also 


(3.D.31c) 


(3.D.32) 


s  u 

pii(Tii)  -  2 


(3.D.33) 


so  that  the  3-dB  down  points  occur  at  f  =  Yii  m  the  exponential  case.  The 

V3 

inflection  point  of  Pjj(f)  occurs  at  f  =  7^-3-. 
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E.  Special  Properties  of  Complex  Correlation  Functions 
1.  Even  and  Odd  Components 
a.  Single  Channel  Case 

In  this  section  we  develop  some  interesting  and  useful  properties  of 
complex  auto-  and  cross-correlation  functions.  We  consider  the  complex, 
stationary,  baseband  random  process 


x(n)  =  xj(n)  +  jxq(n)  (3  .E.  1 . 1 ) 

where  we  have  dropped  the  channel  subscript  notation  for  convenience.  The 
complex  autocorrelation  function  is  obtained  from  eq.  (3.A.2e)  as 


where 


and 


and 


R(l)  =  RA(l)  +  jRB(l) 

(3.E.1.2) 

RA<l)  =  Rn(l)  +  RQQ(l) 

(3.E.1.3a) 

RB®  =  Rqi®  -  Riq© 

(3.E.1.3b) 

1  =  E[xj(n)xj(n-I)]  RqqO)  =  E[xQ(n)xQ(n-l)] 

(3.E.1.3C) 

i  =  E[xj(n)xQ(n-g)]  Rqj(I)  =  E[xQ(n)X](n-l)] 

(3.E.1.3d) 

intent  of  this  section  is  to  consider  some  conditions  under  which  we 

the  special  properties 

RiqO)  =  -  Rqi(I) 

(3.E.1.4) 

Rll(l)  =  Rqq(0 

(3.E.1.5) 

51 


These  equations  are  satisfied  when  x(n)  is  a  wide-sense  stationary 

narrowband  process[see  Section  III.E.2a].  In  this  section,  we  show  that 
eq(3.E.1.4)  is  satisfied  in  general,  when  Rjq(I)  and  Rqj(I)  are  both  odd  functions. 

For  stationary  processes,  we  have  the  following  properties: 

Rii(D  =  R*i(-I)  (3.E.1.6) 

and 

Rij(l)  =  RjiC-h  .  (3.E.1.7) 

Substituting  eq(3.E.1.2)  into  (3.E.1.6),  we  have  (dropping  the  subscript  i) 

Ra(»  +  jRB(»  =  Ra(-0  -  jRB(-0-  (3.E.1.8) 

Equating  real  and  imaginary  terms 

Ra(|)  =  RaM)  (3.E.1.9) 

and 

Rb(I)  =  -Rb(-0  (3.E.1.10) 

indicating  that  R^(l)  and  Rg(l)  are  even  and  odd,  respectively.  Also,  applying 
eq(3.E.1.6)  to  Rjj(l)  and  Rqq(I),  we  have 

Rn(0  =  Rn(-I)  =  Rn(-0  (3.E.l.lla) 

and 

RqqO)  =  RqqC-O  =  RqqC-D  (3.E.1 .1  lb) 

where  the  last  equality  results  because  these  functions  are  real.  Thus,  Rji(I)  and 
Rqq(I)  are  even  functions  of  I.  Applying  eq(3.E.1.7)  to  Riq(I)  and  Rqi(I),  we  have 

Riq(I)  =  Rqi(-D  =  Rqi(-D  (3.E.1.12) 

where  again,  Rqi(I)  is  real. 
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We  note  at  this  point  that  although  Rn(l)  and  Rqq(I)  have  been  shown  to  be 
even  functions,  no  similar  conclusion  can  be  made  at  this  point  about  Rjq(I)  and 
Rqj(I).  However,  expressing  Rqi(I)  in  terms  of  its  even  and  odd  components,  we 

obtain 

Rqi(I)  =  Rqi(I)  +  Rqi(I).  (3.E.1.13) 

Eq.(3.E.1.12)  can  now  be  written  as 

RiqO)  =  Rqi(-D  =  Rqi(-D  +  Rqi<-I).  (3.E.1.14) 

From  the  property  of  even  and  odd  functions 

RiqO)  =  RqiO)-Rqi(D-  (3.E.1.15) 

Solving  for  Rqj(I)  in  eq.(3.E.1.13)  and  substituting  into  eq(3.E.1.15),  we  have 

Riq(D  =  Rqj(I)  -  [Rqi(I)  -  Rqj(I)]  (3.E.1.16a) 

= -Rqi(I)  +  2Rqj(I).  (3.E.1.16b) 

A 

A  similar  equation  is  obtained  by  solving  for  Rqj(I)  in  eq.(3.E.1.13)  so  that 
eq.(3.E.1.15)  becomes 

RiqO)  =  Rqi(I)  -  2Rq[(I).  (3.E.1.17) 

These  last  two  equations  show  *ne  explicit  dependence  of  RiqO)  on  the  evenness 
and  oddness  of  Rqj(I).  These  equations  indicate  that  when  Rqi(I)  has  no  even 

component  (ie.,  when  it  is  an  odd  function), 

Riq(I)  = -Rqi(I)  for  Rq,0)  =  r£,0).  (3.E.1.18) 

On  the  other  hand,  when  Rqi(I)  has  no  odd  component  (ie.  when  it  is  an  even 
function), 

RiqO)  =  +RqiO)  for  Rq,(I)  =  Rqj(I).  (3.E.1.19) 
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These  last  two  equations  can  be  substituted  into  eq.(3.E.1.3b)  to  obtain  the 
extreme  values  of  Rg(l);  ie., 


Rb©  = 


2Rqi© 
.  0 


Rqi(I)  =  Rqi© 
Rqi(I)  =  RqiO)- 


(3. E.  1.20) 


Thus,  the  degree  of  eveness  or  oddness  of  Rqj(I)  [or  Rjq(I)]  controls  the 
imaginary  part  of  the  correlation  function,  Rg(l).  For  Rqj(I)  totally  even,  Rg(l)  = 
0,  so  that  R(l)  is  real.  In  this  case,  the  spectrum  is  even.  As  Rqj(I)  becomes 
progressively  odd,  the  Rg(l)  term  increases  with  the  result  that  the  spectrum 

becomes  distorted  about  the  carrier  frequency. 

At  this  point,  we  note  that  eqs.(3.E.1.16b)  and  (3.E.1.17)  were  developed 
without  imposing  any  restrictions  on  the  process  (x(n)}  other  than  wide-sense 
stationarity.  It  can  be  shown,  however,  that  for  narrowband,  wide-sense 
stationary  bandpass  processes,  eq.(3.E.1.18)  results.  This  is  discussed  in  section 

m.E.2.a.  Apparently,  the  narrowband  restriction  is  a  special  case  which  yields  an 
odd  Rqj(I)  function. 

b.  Multichannel  Case 

In  this  section,  we  consider  several  properties  of  the  complex  cross- 
correlation  function  between  the  two  processes  Xj(n)  and  xj(n)  where 

Xj(n)  =  Xjj(n)  +  jxjg(n)  (3.E.1.21a) 

and 

xj(n)  *  xjj(n)  +  jxjQ(n).  (3.E.  1 .21b) 

Assuming  wide-sense  joint  stationarity,  the  complex  cross-correlation  function  is 
obtained  from  eq(3.A.2e)  as 


Rij(l)  =  RAij(l)  +  jRBij(l) 


(3. E.  1.22) 
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where 

RAjj(!)  =  Ry(l)  +  RyQ(l) 

(3.E.  1.23a) 

RB..(I)  =  Ry‘(l)  -  r’> 

(3. E.  1.23b) 

and 

R?(l)  =  E[xjI(n)xjI(n-l)] 

(3. E.  1.24a) 

R  jfd)  =  E[xiQ(n)xjQ(n-l)] 

(3.E. 1.24b) 

R^l)  =  E[x^,(n)xjQ(n-l)] 

(3. E.  1.24c) 

Ry\l)  =  E[xiQ(n)xj!(n-l)3 

(3.E.1.24d) 

1  Under  the  stationarity  conditions  assumed  here,  we  have  the  relation 

RyCD  =  Rjj(-I). 

(3.E.1.25) 

I  Substituting  eq(3.E.1.22)  into  eq(3.E.1.25)  enables  us  to  obtain 

RAyO)  -  RAji(-l) 

(3. E.  1.26a) 

and 

RByO)  =  -RBji(-i). 

(3. E.  1.26b) 

I  Applying  eq(3.E.1.25)  to  the  real  functions  in  eqs(3.E.1.24),  we  have 

Rij(D  =  Rji(-D 

(3  .E.  1.27 a) 

JO 

'w' 

II 

ja 

1 

'w' 

(3.E.  1.27b) 

II 

A 

04 

(3.E.1.27C) 

s« 

•=:2 

/-s 

II 

50 

.  1— 1 

1 

• 

(3.E.1.27d) 
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2.  Narrowband  Bandpass  Processes 
a.  Single  Channel  Case 

We  now  consider  a  real,  narrowband,  bandpass  process  nj(t)  such  that 

nj(t)  =  Re[xj(t)exp(j27cfc  •  t)]  (3  .E.2. 1 ) 

where  xj(t)  is  the  complex  baseband  process  previously  defined  in  eq(3.A.l)  as 

*i(t)  =  Xjj(t)  +  jxiQ(t).  (3.E.2.2) 

The  quantities  Xjj(t)  and  XjQ(t)  are  the  real-valued  low  pass  quadrature 
components.  Using  eq(3.E.2.2)  in  (3.E.2.1),  the  process  nj(t)  can  be  expressed  in 

canonical  form  as 

ni(l)  =  XiI(t)cos(2jrfcit)  -  xiQ(t)sin(27tfcit).  (3.E.2.3) 

Taking  the  Hilbert  transform  of  eq(3.E.2.3)  and  recognizing  that  the  quadrature 
components  are  low  pass,  we  obtain 

ftj(t)  =  xiI(t)sin(2jcfcit)  +  XiQ(t)cos(27cfcit).  (3.E.2.4) 

Eqs(3.E.2.3)  and  (3.E.2.4)  can  now  be  used  to  solve  for  the  quadrature 
components  resulting  in 

X|j(t)  =  nj(t)cos(27tfc-t)  +  ni(t)sin(27tfc-t)  (3.E.2.5a) 

and 

xjq(t)  =  ni(t)cos(27tfc-t)  -  ni(t)sin(27tfc-t).  (3.E.2.5b) 

In  this  section,  we  will  determine  relationships  between  the  auto-  and  cross- 
correlation  functions  of  the  quadrature  components  of  the  process  xj(t)  under  the 
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assumption  that  nj(t)  is  stationary.  In  this  case  the  correlation  function  of  n;(t)  is 
Rnini(T)  while  the  power  spectral  density  is  Sn-n-(f)  centered  about  ±  fc.. 

Dropping  the  redundant  subscript  i  notation,  we  consider  the  Hilbert  transform  of 
n(t)  as 


dX. 


The  cross-correlation  function  expressed  as 

Rnft(t)  =  E[n(t)ft(t-x)]. 

Substituting  eq  (3.E.2.6)  into  (3.E.2.7) 


Rnn(x)  =  0 


oo 


;  W* 


Interchanging  the  expectation  and  integration 

=  £  fE[nt(tjnf)]d>- 

•OO 

Assuming  wide-sense  stationarity  on  the  bandpass  process. 


Rnn(t-^)=Efn(t)n(^)] 


so  that 


/  \  _  1  f  ^nn(t~^) 

Rnn^T^  ~n  J  t-x- 


dX. 


Now  let  a  =  t  -  X  so  that  dX  =  -  da  and 

— oo 

1  fRnn(a) 


_  ,  .  1_  f%nW/ 

Rnn^x^  n  J  a-x  ^"da^ 


(3.E.2.6) 


(3.E.2.7) 


(3.E.2.8) 


(3.E.2.9) 


(3.E.2.10) 


(3.E.2.11) 


(3.E.2.12a) 
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(3.E.2.12b) 

(3.E.2.12c) 

(3.E.2.13a) 

(3.E.2.13b) 

(3.E.2.13c) 

(3JE.2.13d) 

(3.E.2.14) 

(3.E.2.15) 

(3.E.2.16) 


58 


We  now  consider  the  correlation  functions  associated  with  the  quadrature 
components  defined  in  eq(3.E.2.5a)  and  (3.E.2.5b) 

R,“(t)  =  E[xiI(t)xiI(t--c)]  (3.E.2.17a) 


=  E[n(t)n(t-t)]cos(27cfct)cos[27cfc(t-x)] 
+  E[n(t)n(t-t)]cos(27cfct)sin[2jrfc(t-T)] 
+  E[n(t)n(t-x)]sin(27tfct)cos[27cfc(t-t)] 


+  E[n(t)n(t-x)]sin(2jrfct)sin[27cfc(t-x)]. 

(3.E.2.17b) 

Let 

A  =  2icfct 

(3.E.2.18a) 

B  =  2rcfc(t-x) 

(3.E.2.18b) 

Using  the  identities 

cos(A  -  B)  =  cosAcosB  +  sinAsinB 

(3.E.2.18c) 

sin(A  -  B)  =  sinAcosB  -  cosAsinB 

(3.E.2.18d) 

we  obtain 

cos(2icfct)cos[27cfc(t-x)]  =  cos(2rcfcx)  -  sinAsinB 

(3.E.2.18e) 

cos(27cfct)sin[2jrfc(t-x)]  =  cosAsinB 

(3.E.2.18f) 

sin(27tfct)cos[27cfc(t-x)]  =  sinAcosB 

(3.E.2.18g) 

sin(2jrfct)sin[27cfc(t-x)]  =  sinAsinB 

(3.E.2.18h) 

Using  these  relations  and  eqs(3.E.2.14)  and  (3.E.2.15)  in  (3.E.2.18b) 

n 

Rjj(x)  =  Rnn(x)[cos(27tfcx)  -  sinAsinB] 

■^nn^^^sinB  +  ^nn^1)8^008® 

+  Rnn(x)sinAsinB  (3.E.2.19a) 

=  Rnn(x)[cos(27tfcx)-sinAsinB] 

+  ^nn(T)  t  s“1^cos®  -cosAsinB  ] 
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+  Rnn(x)sinAsinB 

=  Rnn(t)[cos(2jcfcx)-sinAsinB] 
ftnn(^)sin(2fffcx) 

+  Rnn(x)[sinAsinB] 

In  Appendix  B,  we  show  that 


so  that 


Similarly, 


so  that 


^nn(T)  ~  +  ^iinCO 


n 


Rii(x)  =  Rnn(x)cos(2pfcx) 


+  ftnn(x)sin(2jtfcx) 


QQ 

Rii  (x)  =  Rnn(x)cos(2jrfcx) 

+  ftnn(x)sin(27rfcx) 


We  now  consider 

R?f  (x)  =  ElnjCOngCt-x)] 


(3.E.2.19b) 

(3.E.2.19c) 

(3.E.2.20) 

(3.E.2.21) 

(3.E.2.22) 

(3.E.2.23) 

(3.E.2.24a) 
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=  E[n(t)ft(t-x)]cos(27tfct)cos[2itfc(t-x)] 

+  E[n(t)n(t-T)]sin(2jcfct)cos[27cfc(t-x)] 

-  E[n(t)n(t-x)]cos(2jcfct)sin[27cfc(t-x)] 

-  E[n(t)n(t-x)]  sin(27cfct)sin[27rfc(t-x)] 

(3.E.2.24b) 

=  Rjj/^cosAcosB  +  Rnn(x)sinAcosB 

-Rnn(x)cosAsmB  -  RAn(x)sinAsinB  (3.E.2.24c) 

=  R11a(x)cosAcosB  +  Rnn(x)sinAcosB 

-Rnn(^)C0SAsinB  -  RAn(x)sinAsinB  (3.E.2.24d) 


where  eq(3.E.2.20)  was  used  to  in  the  second  term  above.  From  eqs.(3.E.2.12c) 
and  (3.E.2.14) 

RnfiW  =  -  (3.E.2.25a) 

ftnn(x)  (3JE.2.25b) 


so  that 

ID 

Rjj  (x)  =  Rnn(x)[smAcosB  -  cosAsinB] 

-  ftnn(x)[cosAcosB  +  sinAsinB] 
=  Rnn(x)sin(A  -  B)  -  ftnn(x)cos(A  -  B) 

=  Rnn(T)sin(2jrfcT)  ’  &nn(T)C0S(27tfcT)- 

Similarly, 


(3.E.2.26a) 

(3.E.2.26b) 

(3.E.2.26c) 


"  Rii  <x>  =  R|m(x)sin(2irfcx)  -  ftnn(x)cos(2irfcx) 
so  that 

Ru(t)  =  -  r  aV). 


(3.E.2.27d) 


(3.E.2.27e) 
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We  also  note  that  since  Rnn(x)  *s  even  ftnn(x)  *s  °dd,  then 

eq(3.E.2.26c)  indicates  that  R^(x)  is  odd.  It  was  noted  at  the  end  of  section 

in.E.l.a,  that  the  narrowband  process  is  a  special  case  which  results  in  odd  cross- 

IQ  Qi 

correlation  quadrature  components  Rjj  (x)  and  Rjj  (x). 


b.  Multichannel  Case 

We  now  consider  two  real,  narrowband,  bandpass  processes  nj(t)  and  nj(t) 

defined  in  eq(3.E.2.1)  and  develop  properties  similar  to  those  developed  in  the 

previous  section.  Specifically,  we  will  determine  relationships  between  the  cross¬ 
correlation  functions  of  the  quadrature  components  involving  xj(t)  and  xj(t);  ie., 

R?(x),  R  jp(x),  Rjj*(x)  and  R^(x).  The  bandpass  processes  are  expressed  as 

nj(t)  =  Re[xj(t)exp(j2jrfc-t)]  (3.E.2.28a) 

and 

nj(t)  =  Refxj(t)exp(j2jiiCjt)].  (3.E.2.28b) 


In  section  HI.C.3.C,  however,  we  suggested  that  each  channel  process  can  be 


translated  to  a  common  reference  frequency  fCR- 


(3.E.2.41)  can  be  replaced  with  fCR.  Eqs(3.E.2.28)  can  then  be  expressed  as 


nj(t)  =  Re[xj(t)exp(j27cfCRt)]  (3.E.2.28c) 

and 

nj(t)  =  Re[xj(t)exp(j27cfCpt)].  (3.E.2.28d) 

Using  the  quadrature  form  for  xj(t)  and  xj(t)  expressed  in  eq(3.A.l),  we  obtain 
the  canonical  forms  for  the  above  equations  as 

ni(0  =  xiI(t)cos(27rfcRt)  -  XiQ(t)sin(27tfcRt)  (3.E.2.28e) 

and 

nj(t)  =  XjI(t)cos(2jrfcRt)  -  Xjq(t)sin(27rfcRt).  (3.E.2.28f) 
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The  Hilbert  transform  of  nj(t)  is  expressed  as 

A  .  ,  1  fnjW. . 


(3.E.2.29) 


Assuming  wide-sense  joint  stationarity  between  the  two  bandpass  processes,  the 
cross-correlation  function  R_  a  (t)  is  expressed  as 

ninj 

R*(t)  =  E[n;(t)nj(t  t)].  (3.E.2.30) 

Substituting  eq  (3.E.2.29)  into  (3.E.2.30) 


oo 

1  fnj(t)n;(X) 

Ra.(t)  =  E  -  -  K  dX 

Tljnjv  7  7C  J  t-T-X 

_  -oo  _ 

Interchanging  the  expectation  and  integration 

oo 

K  J  t-T-X 


We  now  consider. 


Rninj^t_^  =  E[ni(t)nj(X)] 


so  that 


i  f  %.<*■*•> 


^nj^  =  re  J  t-x-X 


(3.E.2.31) 


(3.E.2.32) 


(3.E.2.33) 


(3.E.2.34) 


Now  let  a  =  t  -  X  so  that  dX  =  -da  and 
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-oo 


oo 


Similarly, 

Rft.n.(x)  =  E[nj(t)nj(t-x)] 
^  J 


oo 


Let  a  =  X-t+x  so  that  dX  =  da  and  eq(3.E.2.36d)  becomes 


oo 


(3.E.2.35a) 

(3.E.2.35b) 

(3.E.2.35C) 

(3.E.2.35d) 

(3.E.2.36a) 

(3.E.2.36b) 

(3.E.2.36c) 

(3.E.2.36d) 

(3.E.2.37a) 

(3.E.2.37b) 
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From  eqs(3.E.2.35d)  and  (3.E.2.37b),  we  have 


Vj(T)='RVj(T)-  (3E-2-38) 

We  now  consider  the  cross-correlation  functions  associated  with  the  quadrature 
components  of  the  Xj(t)  and  xj(t)  processes  defined  in  eqs(3.E.2.5a)  and 

(3.E.2.5b).  First,  consider 

R?(t)  =  E[xu(t)xji(t-T)].  (3.E.2.39) 

Using  eqs(3.E.2.28e)  and  (3.E.2.28f)  and  the  corresponding  Hilbert  transforms, 
we  solve  for 

Xjj(t)  =  nj(t)cos(27cfCRt)  +  ni(t)sin(2jtfCRt)  (3.E.2.40a) 

and 

Xiq(t)  =  nj(t)cos(2jcfCRt)  -  nj(t)sin(27tfCRt).  (3.E.2.40b) 

Using  eq(3.E.2.40a)  and  the  corresponding  equation  for  xjj(t)  in  eq(3.E.2.39),  we 
obtain 

Ry(x)  =  E[ni(t)nj(t-x)]cos(27tfCRt)cos[27tfCR(t-T)] 

+  E[ni(t)nj(t-x)]cos(27tfCRt)sin[27tfCR(t-x)] 

+  E[ni(t)nj(t-x)]sin(27rfCRt)cos[27cfCR(t-x)] 

+  E[ni(t)nj(t-x)]sin(27tfCRt)sin[2jrfCR(t-x)] . 

We  now  define 
A  =  2rcfcRt 


(3.E.2.41) 

(3.E.2.42a) 
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and 


(3.E.2.42b) 


B  =  2itfCR(t-x). 

Let  us  recall  the  identities 

cos(A  -  B)  =  cosAcosB  +  sinAsinB 
sin(A  -  B)  =  sinAcosB  -  cosAsinB. 

Using  eq(3.E.2.42C),  we  have 
cos(2rcfCRt)cos[2itfCR(t-x)]  =  cos(27tfcRx)  -  sinAsinB. 

From  the  identities  defined  above, 
cos(27cfcRt)sin[2jcfcR(t-x)]  =  cosAsinB 

sin(2JtfcRt)cos[2jtfcR(t-x)]  =  sinAcosB 

sin(27cfCRt)sin[27tfCR(t-x)]  =  sinAsinB. 

Eq(3.E.2.41)  can  now  be  written 

n 

Rij(t)  =  Rninj(x)[cos(27rfCRx)  -  sinAsinB] 

+  R_  A.(x)cosAsinB 
"inJ 

+  Ra  .(x)sinAcosB 
ninj 

+  Ra  a  (x)sinAsinB 

ninj 


(3.E.2.42c) 

(3.E.2.42d) 

(3.E.2.42e) 

(3.E.2.42f) 

(3.E.2.42g) 

(3.E.2.42h) 

(3.E.2.43a) 
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=  Rn.nj(x)[cos(2rcfCrT)  -  sinAsinB] 

+  R_  _  (x)[sinAcosB  -  cosAsinB] 
ninj 

+  Ra  A  (x)sinAsinB  (3.E.2.43b) 

ninj 

where  we  have  used  eqs(3.E.2.35d)  and  (3.E.2.37b)  to  obtain  (3.E.2.43b).  In 
Appendix  A,  we  show  that 


^njnj(T) —  Rnjnj(T)  •  (3.E.2.44) 

Using  this  equation  and  the  identity  expressed  in  eq(3.E.2.42d), 

(x)cos(2rcfCRx)+  ftn.nj(T)sin(2icfCRT).  (3.E.2.45) 

Similarly,  using  the  relation  sin(A-B)  =  -sin(B-A),  we  obtain 


Rjj  (x)  =  Rn.n.(x)cos(2jrfCRx)+  fen.n  (x)sin(27tfCRx) 
1  j  ^  J 

so  that 

n  qq 

Rij(x)  =  R Yj  (x). 


(3.E.2.46) 

(3.E.2.47) 


Next,  we  consider 

R^(x)  =  E[xjj(t)xjQ(t-x)]. 


(3.E.2.48) 


Using  eqs(3.E.2.40a)  and  the  j  channel  equivalent  of  eq(3.E.2.40b)  in  (3.E.2.48), 
we  obtain 
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R-j  (t)  =  E[ni(t)ftj(t-t)]cos(27rfCRt)cos[2icfCR(t-x)] 

+  E[ni(t)nj(t-T)]sin(2jcfCRt)cos[27tfCR(t-x)] 
-  E[ni(t)nj(t-x)]cos(27cfCRt)sin[27cfCR(t-x)] 
-E[ni(t)nj(t-x)]sin(27cfCRt)sin[27cfCR(t-x)] 


=  Rjj.^X^osAcosB  +  Rn-n-(x)sinAcosB 
i  j  ^  J 

-  Rn.nj(x)cosAsmB  -  RA.n,(T)sinAsinB 


(3.E.2.49a) 

(3.E.2.49b) 


(3.E.2.49C) 


=  R_  a.(x)cosAcosB  +  Rn.n.(x)sinAcosB 
ninj  i  J 

-  Rn.n.(x)cosAsinB  -  Ra  (x)sinAsinB 

1  J  Ujuj 

where  eq(3.E.2.44)  was  used  in  the  second  term  above.  Using  eqs.(3.E.2.35d)  and 
(3.E.2.37b)  in  (3.E.2.49c) 


Rj:  (x)  =  Rn.n.(x)[sinAcosB  -  cosAsinB] 

J  *  J 

-  ftn.nj(x)[cosAcosB  +  sinAsinB] 

=  Rninj(T)sin(A  -  B>  -  feninj(x)C0S(A -  B> 

•  =  Rninj(x)sin(27CfCRx)  -  ftn.nj(x)cos(27rfCRx). 

Similarly, 

R^(x)  =  E[xiQ(t)xjI(t-x)] 

=  E[ni(t)nj(t-x)]cos(27rfCRt)cos[2jrfCR(t-x)] 

+  E[ni(t)nj(t-x)]cos(27rfCRt)sin[27tfCR(t-x)] 
-E[nj(t)nj(t-x)]sin(2jtfCRt)cos[27cfCR(t-x)] 

-  E[ni(t)nj(t-x)]sin(27ifCRt)sin[27rfCR(t-x)] 


(3.E.2.50a) 

(3.E.2.50b) 

(3.E.2.50C) 


(3.E.2.51a) 


(3.E.2.51b) 
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RA.n( .(^csAcosB  + 
i  j  ^  J 

Rn-n-^sinAcosB  -  R^.a  .(x)sinAsinB 
J  i  J 

RA.n.(T)cosAcosB  +  Rn.n.(x)cosAsinB 
^  J  ^ 

Rn.n.(x)sinAcosB  -  Rn.A  .(x)sinAsmB 
J  i  J 


=  fen.n.(x)[cosAcosB  +  sinAsinB] 
J 

-  Rn|i1j(^)[sinAC0SB  -  cosAsinB] 


—  ^njiij (x)cos(27rfCRt)  -  Rn-nj (x)sin(27cfc^x) 

so  that 

R^(x)  =  -  R^x). 


(3.E.2.51C) 


(3.E.2.51d) 


(3.E.2.51e) 


(3.E.2.51f) 

(3.E.2.52) 
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IV.  ERGODICITY  OF  THE  CORRELATION  FUNCTIONS 
A.  Ergodicity  of  the  Autocorrelation  Function 

Ergodicity  is  the  condition  which  enables  time-averaged  statistics  of 
random  processes  to  approximate  those  obtained  by  ensemble  averages.  This 
condition  is  often  assumed  in  estimation  and  other  signal  processing  applications. 
The  ensemble  autocorrelation  function  is  defined  as  the  expectation  of  lagged 
products  of  a  given  process  when  averaged  over  an  ensemble  of  realizations.  If 
the  time-averaged  autocorrelation  function  obtained  from  a  single  realization 
approximates  this  function,  the  process  is  called  autocorrelation  ergodic.  In  this 
section,  we  derive  the  functional  dependence  of  ergodicity  on  the  correlation 
parameters  defined  in  section  III.C.  Consider  the  time-averaged  estimate  of  the 
autocorrelation  function  expressed  as* 

a  i  N 

RiiTCW  =  2tM  £  *i(n)Xi  (n  - 1).  (4.A.1) 

n=-N 

The  variance  of  &jjT(l,N)  at  each  lag  I  is  expressed  as 

Vjj(l,N)  =  E  { [ftiiT(l,N)  -  E[ftijT(l,N)l][ft;ij(l,N)  -  E[^^(I,N)]] }  (4.A.2a) 

=  E[ftiiT(l,N)ft|4(l,N)]  -  E[£iiT(l,N))E[£ii*(l,N)].  (4.A.2b) 

In  Appendix  B,  it  is  shown  that 


t  In  section  VII.C,  we  will  consider  alternate  forms  of  the  estimator  which  are  used  in 
practice.  These  forms  will  involve  the  biased  and  unbiased  time-averaged  correlation 
function  estimators  using  limited  data  samples.  The  final  expressions  for  the 
variance  of  the  correlation  function  differ  [7]  as  will  be  noted  (Appendix  B).  The 
motivation  for  using  the  definition  of  eq(4.A.l)  is  that  it  will  provide  mathematical 
convenience  in  the  discussion  to  follow.  In  addition,  we  will  develop  expressions 
which  will  reduce  to  those  expressed  in  the  literature  for  the  special  case  of  real 
processes  [6]. 
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(4.A.3a) 


Vii('.N>  =  2?hk!Jl  -2^r]CH(k'') 

and  for  ergodicity  of  the  autocorrelation  function,  we  must 
condition 


lim  Vi;(l,N) 

N-*oo 


lim 

N->oo 


1 

2N+1 


“  2N+1  C<j><()(k^  =  0 


where 

C#(k,l)  =  E[  { <Kn,l)  -  E[<Kn,D] }  {  $ *(n-k,l)  -  E[<t.*(n-k,l)] }  ] 
=  E[<t>(n,l)$*(n-k,l)]  -  E[<K  ..D]E[<>*(n-k,l)] 

-  E[<)>(n,l>]  E[<((  *(n-k,l )]  +  E[<t>(nJ)]Et«t»*(n-k,l)] 

=  R^fk.l)  -  E[ij>(n,l)]E[<|>*(n-k,l)] 


with 

<Kn,l)  =  (n  - 1) 


and 

R#(k,l)  =  E[<Kn,l)4i*(n  -  k,l)]. 

From  eq(4.A.5a) 

E[<|>(nJ)]  =  Rad) 

and 

E[«(.*(n-kJ)]  =  R*;(l) 

so  that  from  eq(4.A.4c) 

C^fk.l)  =  R^fkJ)  -  lRii(l)l2. 

And  so,  eq(4.A.3a)  becomes 

1  2N  Ikl  1 

Vii(  ’N)  “  2N+1  ’  2N+lJ 


maintain  the 

(4.A.3b) 

(4.A.4a) 

(4.A.4b) 

(4.A.4c) 

(4.A.5a) 

(4.A.5b) 
(4.  A. 6a) 

(4.A.6b) 

(4.A.7) 

(4.A.8) 


(4.A.9a) 

(4.A.9b) 


We  now  consider, 

R#(k,l)  =  E[0(n,i)<t>*(n  -  k,l)] 

*  * 

=  E[xj(n)xj  (n  -  l)x^  (n  -  k)xj(n  - 1  -  k)]. 

For  processes  with  zero-mean,  jointly  stationary  Gaussian  quadrature  components 
Xjj(n)  and  xjQ(n),  eq(4.A.9b)  can  be  expressed  as  [see  Appendix  H] 

R<|)<j>(k,l)  =  E[xi(n)xj  (n  -  l)]E[xj  (n  -  k)xj(n  - 1  -  k)] 

+  E[xi(n)xi  (n  -  k)]E[Xi  (n  -  l)xj(n  - 1  -  k)] 

+  E[xj(n)xi(n  - 1  -  k)]E[X|  (n  -  l)xi  (n  -  k)]. 

=  RiiCDR^D  +  Rii(k)R*i(k)  +  Fii(l,k) 

=  lRji(l)l2  +  lRu(k)l2  +  Fii(l,k) 

where 

Fjj(l,k)  =  E[xj(n)xj(n  - 1  -  k)]E[xj  (n  -  l)Xj  (n  -  k)]. 

Using  eq(4.A.10c)  in  (4.A.8),  we  have 

Viid.N)  =  -  2fHr]  [lRii(k)l2  +  Fji(l,k)].  (4.A.12) 

We  note  that  the  functional  dependence  of  Vji(l,N)  on  I  is  due  to  the 
function  Fjj(l,k).  In  Appendix  C,  we  show  that  only  the  :eal  part  of  Fjj(l,k) 

contributes  to  the  summation  in  eq(4.A.12),  so  that 


(4.  A.  10a) 

(4.  A.  10b) 
(4.A.10c) 

(4.A.11) 
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VflON)  =2^  '  air]  [lRii(k)l2  +  Re(Fii(l,k)}]  (4.A.13a) 

and  the  ergodicity  condition  becomes 

Nlim  V„(M=  -j^]  [lRU(k)l2  +  Re{Fjj(IJc)}]  =  0. 

(4.A.13b) 

For  real  processes 

Fji(IJc)  =  E[xi(n)xj(n  - 1  -  k)3E[xj(n  -  l)xj(n  -  k)]  (4.A.14a) 

=  Rii(k  +  l)Rjj(k  - 1)  (4.A.14b) 

=  R|i(l  +  k)Rji(l  -  k)  (4.A.14c) 

and  eq(4.A.13b)  reduces  to  the  discrete  time  form  of  eq(  11-54)  in  [6].  For  a 
specific  value  of  N,  the  variance  expressed  by  the  LHS  of  eq(4.A.13a)  can  now  be 
written  as 


where 


and 


V„(I,N)  =  Ejj(N)  +  LU(I,N) 

(4.A.15) 

Eu(N)  =  2N+1  ^ll1  *  2N+l]  lRii(k)l  ‘ 

(4.A.16a) 

Ljj(l,N)  =  2N+lk=^N[1  '  2N+l]Re{Fii(l’k)}* 

(4.A.16b) 

In  Appendix  C,  it  is  also  shown  that 

Re { F| j(l Jc) }  =  [RCj.(l  +  k)Rcu(l  -  k)  +  RD..(I  +  k)RD..(l  -  k)]  (4.A.17) 

where 
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It  is  also  noted  that  if  the  associated  bandpass  process  for  this  baseband 

process  is  stationary  and  narrowband,  then  eqs(3.E.2.23)  and  (3.E.2.28)  of 
section  HLE.2.a  hold,  and  F|j(l Jc)  is  zero.  And  so,  the  expression  for  Vji(l,N) 

becomes  independent  of  I  and  reduces  to 

Vjj(l,N)  =  Ejj(N)  =  2S7T  JIJ1  '  aHr]  lRii(k>|2'  <4  A'19> 

Using  the  functional  form  for  the  exponential  shaped  autocorrelation 
function,  we  have 

Ra(k)  -  <s\  (Xu)1*1  exp[jeu(k)]  (4.A.20) 

so  that 

lRu(k)l2  =  4  (Xii)2lkl.  (4.A.21) 

Using  eq(4.A.21)  in  (4.A.19),  the  autocorrelation  ergodic  property  holds 
provided 

Nlim  Ejj(N)  =  Jim  ^  JJl  -  4  C>4i)2lkl  =  0  (4.A.22) 

is  true  where  0  <  X[[  <  1.  Thus,  the  form  of  eq(4.A.20)  enables  us  to  express  the 

2 

variance  as  a  function  of  X,jj  and  a--.  We  now  consider  two  limiting  values  for 
Xu  using  eq(4.A.22). 


CASE  1  High  Temporal  Correlation  and  Negligable  Fji(IJc) 


When  kjj  =  1,  the  LHS  of  eq(4.A.22)  reduces  to 


Oji  2N 


aii  2N  |kl 


*  n“So  2N+1  k£l&l) "  N^oo  2N+1  k=&N  2N+1 


'4N+11  4 

=  lim  0NJ, ,  a-  -  lim  ~  X  Ikl 

[2N+1J  ii  (2N+1)2  k=^N 


ii  2N 


N-+00I 


(4.A.23a) 

(4.A.23b) 

(4.A.23c) 


„  4  ..  2N(2N+1)  4  4  _ 

=  20:;  -  lim  - IT  G-  »  O;;  #  0  . 

11  N-*»  (2N+1)2  11 


11 


(4.A.23d) 


Eq(4.A.23d)  indicates  that  for  total  temporal  correlation  (ie.,  X,jj=l),  the  process 


is  not  ergodic. 

CASE  2  Low  Temporal  Correlation  and  Negligable  Fjj(l,k) 


When  »  0,  non-negligeable  terms  occur  only  at  k  =  0,  so  that 

eq(4.A.19)  reduces  to 

lim  Ejj(N)  =  lim  [ Vfi  =  0. 

N-*oo  N-40oLzi><+1J  11 


(4.A.24) 


Thus,  ergodicity  holds  and  time  averages  may  provide  good  results  for 
sufficiently  high  values  of  N. 

In  Fig  4.A.la,  we  plot  Ejj(NT)  expressed  in  eq(4.A.22)  as  a  function  of  \[[ 
where  0  <  X\\  <  1  for  the  total  number  of  sample  observations  NT=2N+1  ranging 
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from  100  to  10,000.  In  Fig  4. A.  lb,  we  plot  Ejj(NT)  as  a  function  of  NT  for 
specific  values  of  We  again  emphasize  that  in  these  cases,  that  Fji(l,k)  is 
negligible.  For  Fji(IJc)  ^  0,  Vjj(«)  is  a  function  of  I.  The  I  dependence  also 

occurs  when  estimating  with  limited  data  (see  Section  VII).  Fig.4.A.l  provides  a 
measure  of  die  variance  of  the  time-averaged  autocorrelation  function  in  terms  of 
the  temporal  correlation  for  specific  sample  integration  sizes.  Specifically,  Fig 

4. A.  lb  provides  two  important  features.  First,  it  reveals  the  convergence  limit  of 
Ejj(N)  as  N  approaches  large  values.  Second,  it  provides  a  performance  measure 

which  indicates  the  required  sample  size  to  obtain  a  specific  value  for  the 
variance  of  the  autocorrelation  function.  As  this  figure  shows,  as  approaches 

unity  (ie.,  high  temporal  correlation),  the  sample  size  requirement  increases 
significantly.  In  section VII.C,  we  will  consider  Ejj(N)  using  autoregressive 

processes.  For  these  processes,  we  utilize  the  autocorrelation  function  for  AR 
processes  in  eq(4.A.19). 

Finally,  we  note  that  for  stationary  processes  with  A.jj  ^  1,  there  exists  a 

value  of  N0\.X.jj)  such  that  for  NT  >  N0(Xjj)  ergodicity  of  the  autocorrelation 

function  approximately  holds;  ie.,  for  Xii  <  1,  there  is  a  number  of  required 
sample  observations  N0(A^j)  such  that  for 

NT  >  N0(^ii)  (4.A.25a) 

there  is  an  e  such  that 

Vii(l)  <  e  (4.A.25b) 

where  Nt  is  the  total  number  of  sample  observations  and  e  is  arbitrarily  small. 
The  ergodicity  condition  results  since  Vjj(l)  is  monotonically  decreasing. 
However,  as  noted  above,  for  values  of  A.jj  close  to  unity,  NT  may  be  extremely 
large  in  order  to  reduce  the  variance  to  a  required  value.  Finally,  for  A.jpl, 

ergodicity  no  longer  holds. 
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B.  Ergodicity  of  the  Cross-Correlation  Function 

For  the  cross-correlation  function,  lagged  products  between  two  processes 

are  averaged  over  an  ensemble  of  realizations.  In  this  case,  we  consider  wide- 
sense  jointly  stationary  processes  Xj(n)  and  xj(n)  such  that 


P(n,l)  =  xj(n)  xj  (n  - 1).  (4.B.1) 

The  autocorrelation  function  for  (3(n)  is  expressed  as 

Rpp(k,l)  =  E[p(n)p*(n  -  k)].  (4.B.2) 

From  eq(4.B.l) 

E[p(n,l)]  =  Rjj(l)  (4.B.3a) 

E[p*(n  -  k,l)]  =  Ry(l).  (4.B.3b) 

Using  the  same  form  as  eq(4.A.4c) 

Cpp(k,l)  =  Rpp(k.l)  -  E[P(n,l)]  E[p*(n  -  k,l)]  (4.B.4a) 

=  Rpp(k,l)  -  lRij(l)l2.  (4.B.4b) 

The  variance  of  the  time-averaged  cross-correlation  function  is  therefore 

expressed  as 

Vij<'*N>  =  Xil  '  2N+l]  <4'B'5> 


For  ergodicity  of  the  cross-correlation  function,  we  must  maintain  the  condition 


lim  Vii(U^)  = 

N-»<»  J 


lim 

N-kOO 


1 

2N+1 


Ikl 


2N+1 


Cpp(k,l)  =  0. 


(4.B.6) 
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Using  eq(4.B.4b)  in  (4.B.5),  we  have 


Vjj(l,N)  =  ab  •  zir]  [Rpp(k,D  -  lRijO)l2]-  (4.B.7) 

We  now  consider 

Rpp(k,l)  =  E[P(n,l)p*(n  -  k,l)] 

=  E[xj(n)Xj  (n  -  l)xj  (n  -  k)xj(n  - 1  -  k)] 

so  that  eq(4.B  .5)  becomes 

v  /lKn _ L_  2N  l\  Ikl  ' 

Vy(  ,N)  ~  2N+1  "  2N+1J  * 

{  E[xj(n)X|  (n  - Ijxj  (n  -  k)xj(n  - 1  -  k)]  -  lRjj(l)l2] } .  (4.B .9) 

For  processes  with  zero-mean,  jointly  stationary,  Gaussian  quadrature 


components,  eq(4.B.8b)  can  be  expressed  as  (see  Appendix  H) 

Rpp(kJ)  =  E[xj(n)xj  (n  -  OJEfy  (n  -  k)xj(n  - 1  -  k)] 

+  E[xi(n)Xj  (n  -  k)]E[xj  (n  -  l)xj(n  - 1  -  k)] 

+  E[xj(n)xj(n  - 1  -  k)]E[xj  (n  -  l)xj  (n  -  k)] 

(4.B.10a) 

=  Rjj(l)Rjj(l)  +  Rii(k)Rj|j(k)  +  Fij(l,k) 

(4.B.10b) 

=  iRjjd)!2  +  R;j(k)R*(k)  +  Fjj(IJc) 

(4.B.10c) 

where 


(4.B.8a) 

(4.B.8b) 
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(4.B.11) 


Fjj(Uc)  =  E[xj(n)xj(n  - 1  -  k)]E[xj  (n  -  l)xj  (n  -  k)]. 

Using  eq(4.B.10c)  in  (4.B.7),  we  obtain 

1  2N  r  Bel  1  * 

Vij(!,N)  =  2N+1  "  2N+1J  P^iiG^jjOO  +  Fjj(l,k)].  (4.B.12) 

In  Appendix  D,  we  show  that  the  summation  in  eq(4.B.12)  over  positive 

* 

and  negative  values  cancels  the  imaginary  terms  in  Rjj(k)Rjj(k)  and  Fjj(l,k),  so 


Vjj(l,N)  -  2N+1 


1  - 


Ikl  1  * 

2n^J  Re[Rii(k)Rjj(k)  +  Fy(IJt)]. 


(4.B.13) 


We  note  that  the  term  Re[Fy(l,k)]  will  contribute  a  dependence  of  Vj;(l,N)  upon 
cross-correlation  terms  such  as  Ipjjl.  The  ergodicity  condition  expressed  by 
eq(4.B.6)  now  reduces  to 

1  2N  r  ivi  i  * 

NIim  Vij(l,N)  =  NIim  RefR^OO  +  Fyfljc)]  =  0. 

(4.B.14) 

In  Appendix  D,  it  is  also  noted  that  for  each  of  these  real  terms,  their  values  at 
positive  k  equals  those  at  negative  k,  so  that 

1  2N  F  Ikl  1  r  * 

VflftN)  =  2nSI|i|)[1  *  2N+tJ  { 2Re[Rii(k)Rjj(k)  +  Fyd.k)] 

*[Rii(0)Rjj(0)  +  Fjj(l,0)] } .  (4.B.15) 

The  term  at  k=0  is  subtracted  so  that  it  is  not  counted  twice.  Finally,  it  is  also 

shown  (see  Appendix  D)  that  if  the  corresponding  bandpass  processes  are  jointly 
stationary  and  narrowband,  then  Fjj(l,k)=0  so  that 

Vjj(l,N)  =  Eij(N)  (4.B.16a) 
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where 


•¥N> = m  kU'  -  m]  R«tRiiWR>)]-  (4.B.i6b> 

We  now  consider  the  functional  dependence  of  eq(4.B.i6)  on  the  coiTelation 
parameters. 

CASE  1  High  Temporal  Correlation  and  Negligable  Fjj(l^c) 


Using  the  Gaussian  shaped  functional  form  of  eq(3.C.13a)  for  the 
autocorrelation  functions,  eq(4.B.16b)  becomes 


2  2 
°iiCTjj 


2N  f  |k!  1  u2 

VflON)  =  Eij(N)=  2NTT  k=?2N[‘  '  2N+rj(^‘>k  % 


cos  [0ji(k)  -  0jj(k)] 


(4.B.17) 


For  high  temporal  correlation  on  the  i  and  j  processes,  Xjj  s  Xjj  s  1.  In 
this  case,  large  values  of  N  are  required  to  reduce  Vy(l,N).  For  total  temporal 
correlation  on  both  channels  (ie.,  X.ii-Xjj  =1)  and  real  correlation  functions  [so 
that  0jj(k)=0jj(k)=O  and  the  spectra  are  even],  the  LHS  of  eq(4.B.14)  simplifies 

to 


lim  E;;(N) 

N-*oo  J 


2  2 

2N+I  kI2ll  '  2N+l](^i)k  (Xij)k 

2  2  2  2 

°ii°jj  aii°jj 

M  2N  2N  |kl 

N^oo  2N+1  ki2N(1)  ’  n™  2N+1  k=4N  2N+1 


(4.B.18a) 

(4.B.18b) 
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(4.B.18C) 


lim 

N-»oo 


2N(2N+1)T2  2 
(2N+1)2 


,  2  2  22  2  2  ,a 
2<Tii°jj  ‘  =  °ii°jj  *  °’ 


(4.B.18d) 


Eq(4.B.18d)  indicates  that  in  the  case  of  total  temporal  correlation,  the  cross¬ 
correlation  function  does  not  maintain  the  ergodicity  condition. 


CASE  2  Low  Temporal  Correlation  and  Negligable  Fjj(ldc) 

In  this  case,  we  consider  processes  i  and  j  with  low  temporal  correlation  so 
that  A.||  *  A.jj  =  0.  If  Fjj(l,k)=0,  eq(4.B.16b)  applies.  Again,  considering  real. 


Gaussian  correlation  functions,  we  have 


lim  E;;(N)  = 

N-*oo 


lim 


2  2 
(T»  • 

ii  jj 

2N+1 


Ikl 


2N+1 


(4.B.19) 


For  small  A.jj  and  Ajj  ,  only  the  k  =  0  term  is  significant  so  that 


2  2 
aii°ii 

fonJSijW  =  ^2^  =  °' 


(4.B.20) 


Ergodicity  holds  for  this  case  so  that  time  averages  may  provide  good 
results  for  sufficiently  high  values  of  N.  This  condition  will  also  be  maintained 
provided  either  Xjj  or  Xjj  is  sufficiently  small.  However,  larger  values  of  N  will 

be.  required  to  reduce  Ejj(N)  to  a  specified  value. 

CASE  3  Non-Negligable  Fy(U) 

In  this  case,  Re[Fjj(l»k)]  contributes  to  Vjj(l,N)  in  eq(4.B.13).  Eq(D.8b)  in 

Appendix  D  expresses  this  function  in  terms  of  the  correlation  functions  of  the 
quadrature  terms.  In  general,  these  terms  describe  the  dependence  of  Vy(»)  upon 

lag  I  as  well  as  the  cross-correlation  between  the  ith  and  jth  processes. 
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V.  MULTICHANNEL  AUTOREGRESSIVE  PROCESS  MODELS 


A.  DEFINITION  OF  THE  AR  PROCESS 

In  this  analysis,  the  multichannel  observation  processes  obtained  under 
hypotheses  Hi  with  i  =  0,  1  are  assumed  to  be  generated  by  multichannel 
autoregressive  processes.  The  multichannel  Jxl  vector  process  x  (nlHO  with 
i=0,l  is  expressed  as 

Mi  H 

s(nlHj)  =  -  £  A  Mj(klHj)x(n-k)  +  i  =  0,1  (5.1) 

k=l 


where  AMj(klHi)  is  the  kth  JxJ  matrix  coefficient  for  an  AR  process  of  model 

order  Mi.  We  note  that  it  is  expressed  in  terms  of  the  Hermitian  operation  for 
notational  convenience,  but  is  not  treated  here  as  a  Hermitian  matrix.  The  vector 
u(n)  is  a  Jxl  white  noise  driving  vector  which,  in  general,  has  an  arbitrary 
correlation  across  the  J  channels  so  that 

„  f [0]  I  0 

E[u(n)uH(n  - 1)  =  |ruu(0)  =  [If]  I  =  0.  (5-2) 

Ruu  (0)  a  [Ef]  is  the  JxJ  covariance  matrix  of  the  vector  process  u(n)  and  may 

have  off-diagonal  components.  Since  u  (n)  is  uncorrelated  in  time,  but  retains  an 
arbitrary  correlation  across  channels,  then  with  wide-sense  joint  stationarity  of 
the  channel  processes  assumed,  we  can  consider 

U  (n)  =  Cy  (n)  (5.3) 

where  the  J  x  J  matrix  C  is  a  constant  matrix.  This  matrix  gives  rise  to  the 
channel  correlation  on  u  (n).  The  vector  y  (n)  is  a  Gaussian  white  noise  vector 
uncorrelated  in  time  and  across  channels  such  that 

u  .  f[0]  I  *  0 

E[y(n)yH(n-l)  =  |Dv  j  =  0  (5.4) 
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The  elements  of  the  diagonal  matrix  Dv  are  the  variance  terms  associated  with  the 
white  noise  driving  term  on  each  channel.  And  so,  from  eq  (5.3)  we  can  obtain 
the  zero-lag  correlation  matrix  (assuming  wide-sense  stationarity) 

Ruu  (0)  =  E  [y  (n)  y  H(n)]  =  [If]  (5.5a) 

=  E  [  Ci  (n)  x  H(n)  CH]  (5.5b) 

=  CDyCH  (5.5c) 

We  could  assume  unit  variance  on  all  elements  of  Dv  without  loss  of  generality  so 
that  Dv  =  I.  The  significance  of  this  discussion  is  that  the  correlation  matrix 
Ruu(0)  is  a  constant  matrix  associated  with  the  white  noise  driving  term  y  (n). 
The  correlation  between  the  channel  elements  of  y  (n)  gives  rise  to  the  off- 
diagonal  terms  in  RUu(0).  Since  RUu  (0)  expressed  in  eq  (5.5)  is  Hermitiant, 
positive  semi-definite,  we  could  also  perform  an  LDLH  decomposition  such  that 

Ruu(0)  =  LUDULUH  (5.6) 


where  Lu  is  unit  diagonal  lower  triangular.  Solving  for  Du?  we  obtain 


Du  =  Lu-lRuu  (0)  (LU-1)H  (5.7a) 

=  E  [Lu*  lu.  (n)  uH  (n)  (Lu- 1  )**]  (5 .7b) 

=  E[j(n)zH(n)]  (5.7c) 

where 

L  (n)  =  Lu'1  y  (n)  (5.8) 


so  that  £  (n)  is  a  J  x  1  vector  containing  uncorrelated  elements.  It  represents  an 
underlying  process  of  the  multichannel  AR  process  which  can  be  viewed  as  a 
'  spatially-causal"  white  noise  driving  term.  Since  Lu*1  is  also  lower  triangular 
unit  diagonal,  it  is  invertible  so  that  from  eq  (5.8) 


t  It  is  noted  that  in  general  the  correlation  matrix  Ruu  (I)  is  not  Hermitian 
for  1*0 . 
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H  (n)  =  Lui  (n) 


(5.9) 


Eq  (5.9)  indicates  that  u  (n) ,  originally  defined  in  eq  (5.3) ,  could  identically  be 
generated  by  the  z  (n)  process  through  the  transformation  matrix  Lu;  i.e.  eq  (5.1) 

can  be  written  in  the  equivalent  form 

Mi 

S(nlHj)  =  -  £  AMiOdHi)i(n-k)  +  LuCHi^nlH,)  i  =  0,1  (5.10) 

k=l 

where  Lu  (Hi)  denotes  the  specific  matrix  Lu  under  hypothesis  Hi.  In  [1],  a  two 
stage  multichannel  prediction  error  filter  is  considered  which  uses  estimates  of 

the  A]vii(klHi)  coefficients  to  obtain  an  approximation  of  u  (n)  in  the  first  stage 

and  an  estimate  of  Lu'1  to  obtain  an  approximation  of  the  temporally  and  spatially 
uncorrelated  process  z  (nlHi). 

B.  THE  YULE-WALKER  EQUATION 

The  relationship  between  the  matrix  coefficients  Am 00,  the  covarince 
matrix  [If]  of  the  forward  AR  driving  noise  vector  and  the  known  correlation 
matrix  Rm  from  eq(2.3)  can  be  expressed  [2]  as 

AmIRss]  »  ([%]  [0]  --[0]}  (5.11) 

where 

Am  =  [!  am(D  Am©  -  a“(M)].  (5.12a) 

and 

[If]  =  E[n(n)nH(n)]  (5.12b) 

The  matrix  [  Rxx]  is  the  reversed  order  correlation  matrix  of  [RM];  i.e.,  the 
correlation  matrix  obtained  with  the  time  order  of  the  vector  ^  N  from  eq(2.4b) 

reversed.  The  corresponding  equations  for  the  stationary,  backward  AR  process 
is  expressed  as 

BM(RiS]  =  {[0]...[0][Ib]H}  (5.13) 
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where 


fi$  =  [Bm(M)...Bm(1)  n  (5.14) 

and  [Z^]  is  the  covariance  matrix  of  the  backward  AR  driving  noise  vector. 

Eqs(5.11)  and  (5.13)  are  the  augmented  forms  of  the  multichannel  Yule-Walker 
equations. 
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VL  PROCESS  SYNTHESIS 
A.  General  Procedure 

In  this  section,  we  discuss  the  synthesis  procedure  used  to  generate  wide- 
sense  stationary,  multichannel  autoregressive  processes  with  Gaussian  statistics. 
The  Jxl  vectors  s.(n)  and  £.(n)  defined  in  eq(2.1)  are  generated  as  distinct, 
multichannel  AR  processes  for  the  signal  and  non* white  noise,  respectively, 
although  each  channel  will  be  an  ARMA  process  [16,17,10].  They  are  controlled 
individually  using  the  scheme  shown  in  Fig  6.A.1  which  is  similar  to  that 
suggested  in  [2]  for  scalar  process  synthesis.  In  this  paper,  the  synthesis 
procedure  is  generalized  to  consider  multichannel  vector  processes  in  which  we 
are  able  to  control  the  variance  and  temporal  correlation  on  each  channel,  the 
cross-channel  correlation  as  well  as  the  signal-to-noise  (S/N)  and  clutter-to-noise 
(C/N)  ratios. 


Figure  6.A.1 


In  section  m.C,  we  discussed  a  method  to  shape  the  magnitude  and  phase  of 
correlation  functions  with  various  functional  forms.  Once  these  correlation 
functions  have  been  determined  to  obtain  a  desired  spectral  shape,  the  Yule- 
Walker  equation  presented  in  section  IV  can  be  used  to  determine  the  AR 
coefficients  for  the  process  with  a  model  order  chosen  to  fit  the  desired  spectrum 
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within  certain  tolerance  specifications.  In  the  procedure  used  here,  correlation 
functions  for  the  signal  and  non- white  noise  are  specified  separately  using  Rs„(l) 

and  Rc.j(i),  respectively.  The  autoregressive  PSD  which  would  result  from  these 

coefficients  provides  a  fit  to  the  desired  spectrum.  Alternatively,  when  these 
coefficients  are  used  in  the  AR  equation,  we  are  able  to  generate  processes  which 
provide  a  fit  to  the  desired  spectrum  in  a  MMSE  sense.  Specifically,  the 
following  procedure  is  used  to  generate  the  AR  time  sequenced  values: 


(1)  the  desired  shapes  of  the  autocorrelation  and  cross-correlation  values  are 
obtained  using  the  f(«)  functions  by  the  methods  of  section  III.C. 

(2)  the  order  of  the  AR  process  (for  synthesis)  is  selected  based  upon  a 

specified  tolerance  for  fitting  the  desired  spectrum. 

(3)  the  values  of  Rs. .(I)  and  Rc..(l)  form  the  signal  and  clutter  correlation 

matrix  elements  designated  as  R§£  and  Rg£,  respectively. 

(4)  the  multichannel  Yule-Walker  equations  are  solved  using  the  Levinson- 
Wiggins-Robinson  recursion  [151  to  determine  the  matrix  coefficients 

Ag  (k)  and  [Ef]^  for  k  =  1,  2,  ...,Mg;  i.e., 


Ag  [Rggl^ffflg  [01...10]) 

where 

Ag  =  [I  Ag  (1)  Ag  (2)...Ag  (Mg)] 
H 

Rgg  =  E^|n^-Mgin,n-Mg] 

|n,n-Mg  55  teT(n>  ST(n-l)...*T(n-Mg)] 

[Xf]g  =  E[ug(n)i£(n)]  =  [Iflg 
lig(n)  =  [uf(n)  uf(n)  ...uf(n)3 


OQ 

II 

VI 

«• 

O 

(6.A.1) 

g  =  s,c 

(6.A.2) 

g  =  s,c 

(6.A.3a) 

g  =  s,c 

(6.A.3b) 

g  =  s,c 

(6.A.4) 

g  =  s,c 

(6.A.5) 
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(5)  the  values  of  Ag  (k)  are  now  used  in  the  generation  of  &(n)  and  c(n)  via  the 
equation 

Mg 

£(n)  =  -  5Ta2  (k)fi(n-k)  +  Ug(n)  g  =  s,c  (6.A.6) 

k=l  6 

where  Mg  is  the  order  of  the  signal  model,  Ag  (k)  is  the  matrix  coefficient  of  the 

process  g.(n)  and  Ug(n)  is  a  white  noise  driving  vector  with  covariance  matrix 
[Lf]g.  The  vectors  Ug(n)  and  w(n)  are  generated  using 

Ug(n)  =  CgVg(n)  g  =  s,c  (6.A.7a) 

and 

w(n)  =  Cwvw(n)  (6.A.7b) 

where  vg(n)  g=s,c  and  vw(n)  arc  white  noise  vectors  with  unit  variance  on  each 

channel.  Using  eqs(6.A.7),  we  obtain 

[2f]g  =  E[jig(n)s£(n)]  =  E[Cgvg(n)i£(n)Cg]  g  =  s,c  (6.A.8a) 

and 

RWw(°)  =  E[w(n)wH(n)]  =  E[Cwvw(n)v^(n)C^].  (6.  A. 8b) 

Using 

E[xg(n)Y^(n)]  =  E[vw(n)v^(n)]  =  I  (6.A.9) 

where  I  is  a  JxJ  identity  matrix,  eqs(6.A.8)  can  be  written  as 

[Ef]g  =  CgE[vg(n)v^(n)]Cg  =  CgCg  g  =  s,c  (6.  A.  10a) 

and 

Rww^  =  CwE[Yw(n)vw(n)]Cw  =  (6.A.10b) 
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Eqs(6.A.10)  indicate  that  Cg  and  Cw  can  be  obtained  by  the  Cholesky 
decomposition  of  [Ef]g  and  Rww(0),  respectively.  The  vectors  us(n),  Mc(n)  and 

vy(n)  in  Fig  6.A.1  are  therefore  controlled  to  be  zero-mean,  Gaussian  white  noise 
vectors  uncorrelated  in  time  but  with  an  arbitrary  correlation  across  channels; 
ie., 

H  \  101  l=/° 

E[Ug(n)Ug  (n-l)]  =  R®u(0)-[£f]g  1=0  g  =  s,c  (6.A.11) 

Etw(n)wH(n-l)]  =  {r^O)  m.  (6.A.12) 

In  general,  the  matrices  [Ef]g  and  Rww(0)  have  off-diagonal  components. 
The  functions  Hs  (z)  and  Hc  (z)  are  the  model  filter  transfer  functions  for  the 
synthesis  of  the  signal  and  clutter  processes,  respectively. 

EXAMPLE 

In  this  example,  we  consider  the  synthesis  of  a  real,  single  channel  AR 
process  of  order  two  using  real,  Gaussian  shaped  correlation  functions.  The 
correlation  function  is  therefore  expressed  as 

RS(D  =  Oj  (X,)'2.  (6.A.13) 

The  Yule- Walker  equation  for  this  case  is 

’  R(0)  R(l)  R(2)  T  i  I  I"  " 

R(-l)  R(0)  R(l)  a(l)  =  Q  (6.A.14) 

-  R(-2)  R(-l)  R(0)  1  a(2)  J  L  0  . 

2 

where  au  is  the  variance  of  the  white  noise  driving  term  of  the  associated  AR 

process.  Using  the  functional  form  of  eq(6.A.13)  in  (6. A.  14)  and  solving  for  the 
coefficients,  we  have  (dropping  the  script  s  notation) 
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R(2)R(-1)  -  R(1)R(0)  2 

au)  _  R(0)R(0)  -  R(1)R(-1)  “ '  sl  s  +  l> 

(6.A.15) 

_  R(1)R(1)  -  R(2)R(0)  _  2 
“  R(0)R(0)  -  R(1)R(-1)  _ 

(6.A.16) 

=  R(0)  +  a(l)R(+l)  +  a(2)R(+2) 

(6.A.17a) 

2  2, 2  , 2  2,6 
=  <Ts-osXs(Xs  +  1)  +  os>.s 

(6.  A.  17b) 

2  ,2  ,4  ,6, 

=  as[l-  A.s-Xs+Xs] 

(6.A.17c) 

We  now  consider  the  effect  of  these  results  when  used  in  the  AR  equation 
(6.A.6);  ie., 

s(n)  =  -  a(l)s(n-l)  -  a(2)s(n-2)  +  u(n).  (6.A.18) 

Using  eqs(6.A.15)  and  (6.A.16)  in  (6.A.18),  we  have 

s(n)  =  Xs(xl  +  l)s(n-l)  -  X.jS(n-2)  +  u(n)  (6.A.19) 

2 

where  the  white  noise  driving  term  u(n)  has  the  variance  ou.  We  note  from 

eq(6.A.13)  that  as  A.s  approaches  zero,  the  correlation  function  approaches  a  delta 

2 

function  with  variance  Therefore,  s(n)  is  expected  to  be  an  uncorrelated 

2 

white  noise  process  with  variance  a§.  Examination  of  eq(6.A.19)  indicates  that 

s(n)  is  approaching  the  white  noise  process  u(n)  for  small  Xs  since  the  AR 

coefficients  are  becoming  vanishingly  small.  In  addition,  eq(6.A.17c)  indicates 
that  the  variance  of  u(n)  is  approximated  by  that  of  s(n)  as  required.  We 
therefore  have  a  method  for  process  synthesis  that  allows  one  to  control  the 
variance  and  temporal  correlation  over  a  wide  range  of  values.  Furtheremore, 
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for  a  specific  a§,  the  variance  of  the  synthesized  processes  will  remain  fixed 
independent  of  the  choice  of  X,s. 

B.  Alternate  Approach 

We  could  characterize  the  observation  processes  i(nlHj)  defined  in  eq(2.1) 

as  multichannel  AR  processes  under  each  hypothesis.  We  would  then  have 
Mi  H 

x(nlHj)  =  -  X  AMi(klHi)x(n-k)  +  mOiIHj)  i  =  0,1  (6.B.1) 

k=l 

H 

where  Mi ,  AMj(klHi)  and  j*  (nlHi)  denote  the  model  order,  the  matrix  coefficients 

and  the  white  noise  driving  term  under  each  hypothesis,  respectively.  Eq  (6.B.1) 
could  be  utilized  to  generate  the  processes  under  each  hypothesis  using 
predetermined  values  for  the  coefficients.  This  approach  is  useful  in  the 
diagnostics  of  parameter  estimation  algorithms;  i.e.,  one  could  validate  that  the 
estimates  of  the  coefficients  converge  to  the  known  preassigned  model 
coefficients  as  well  as  assess  the  convergence  rate  and  final  error  variance.  This 
approach,  however,  does  not  allow  control  over  the  variations  of  the  signal-to- 
noise  (S/N)  and/or  signal-to-clutter  (S/C)  ratios  for  parametric  performance 
evaluations. 

C.  Complex  Processes  with  Jointly  Gaussian  Quadrature  Components 

In  this  section,  we  discuss  the  conditions  which  enable  us  to  control  the 

Gaussian  statistics  of  the  synthesized  processes.  We  accomplish  this  through  the 
white  noise  driving  vectors,  Ug(n)  and  Vg(n)  in  eq(6.A.7).  Initially,  we  present 

the  constraints  on  the  quadrature  correlation  functions  associated  with  v.g(n)  in 

order  to  obtain  conventional  complex  Gaussian  processes.  Next,  we  relax  these 
constraints  in  order  to  synthesize  the  more  general  case  of  complex  processes 
which  contain  correlated  Gaussian  quadrature  components. 

Let  us  now  consider  expressing  y.g(n)  and  Cg  in  eq(6.A.7)  using  their 
quadrature  components  so  that  (dropping  the  g  subscript) 


and 


i(n)  =  ijCn)  +  j  yq(n) 


(6.C.la) 


C  =  CI  +  jCQ.  (6.C.lb) 

Using  these  expressions  in  (6.A.7),  we  obtain 

li(n)  =  Cy(n)  (6.C.2a) 

=  [Ci  +  j  Cq]^)  +  j  VQ(n)]  (6.C.2b) 

=  [CIvI(n)  -  CqVq(ii)]  +  j  [Cqv^ii)  +  (^(n)]  (6.C.2c) 

so  that 

Ui(n)  =  Cj^jCn)  -  CQYQ(n)  (6.C.3a) 

Uq( n)  =  CQjr^n)  +  CjVQCn).  (6.C.3b) 

We  now  have 

R>  =  EtujCn)^  (n)]  (6.C.4a) 

=  E { [Cjv^n)  -  CQVQ(n)][v[(n)c[  -  VQ(n)Cq]}  (6.C.4b) 


n  T  OO  T  OI  T  IO  T 

=  C^mi  +  CqR^(0)Cq  -  CqR^(0)Ci  -  CjR^OXTq  (6.C.4C) 

Similarly, 

QQ  T 

Ruu  (0)  =  E[uQ(n)uQ(n)]  (6.C.5a) 

=  E  { [CQXj(n)  +  CjVQ(n)]  [yj  (n)CQ  +  y.Q(n)C^ ] }  (6.C.5b) 

n  t  or  t  io  t  oo  t 
*  CqRw(0)Cq  +  CiR^v(0)Cq  +  CqR^(0)Ci  +  CjRfj  (0)Cf  (6.C.5c) 

R>  =  E[Mi(n)iiQ(n)] 


(6.C.6a) 


(6.C.6b) 


=  E{  [CjXiCn)  -  CqVq(ii)]  £sj  (ii)Cq  +  ^Q(n)cJ] } 

IT  T  OI  T  TO  T  oo  T 

=  C^OJCq  -  CqR„(0)Cq  +  QR^OC,1  -  CqR„  (OQ  (6.C.6c) 
Rui(°)  =  e&JqWw  (»>]  (6-C.7a) 

=  E  {  [CqSjW  +  C^nMba  (n)c[-  iq(n)CQ] }  (6.C.7b) 

=  CqR^v(0)C?'+  CiR<^(0>C?'-  CqR^(0)Cq  -  C,R^(0)Cq.  (6.C.7c) 


In  the  special  case  where 

R^v(0)  =  R^(0)  =  \l  (6.C.8a) 

R^(0)  =  R®(0)  =  0  (6.C.8b) 

and  I  is  the  identity  matrix,  we  have 

rJ[u(0)  =  jCiC?'  +  5  CqCq  (6.C.9a) 

R^(0)  =  5  CqCq  +  j  CfJ  (6.C.9b) 

ru^(0)  =  |cic5-2CqC[  (6.C.9c) 

R^(0)  =  jCgC?  -  jQC^  (6.C.9d) 

so  that 

R>  =  ^(0>  (6.C.10a) 


and 
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R^(0)  =  -  R^(0). 


(6.C.10b) 


In  the  farther  restricted  case  where  Cq=0  (which  occurs  when  the  correlation 
functions  in  the  Yule-Walker  equation  are  real) 

rJS(0)--R®(0)-[0].  (6.C.11) 

The  conditions  expressed  by  eqs(6.C.10a)  and  (6.C.10b)  are  those  required 

to  ensure  that  the  magnitude  of  the  complex  process  u(n)  is  Gaussian.  We  note 

that  these  conditions  result  when  eqs(6.C.8a)  and  (6.C.8b)  hold;  ie.,  when  the 

2 

white  noise  driving  vector  v(n)  has  variances  of  ay  H  on  each  channel  quadrature 

component  and  the  quadrature  components  on  each  channel  are  uncorrelated.  In 
this  special  case,  eq(6.A.8b)  is  maintained;  ie., 

E[s(o)xH(n)]  =  Dv  =  I.  (6.C.12) 

If  we  generalize  this  case  so  that  i(n)  has  an  arbitrary  variance  on  each  channel 
quadrature  component  as  well  as  an  arbitrary  correlation  between  the  Gaussian 
quadrature  components  on  each  channel,  the  resulting  u(n)  is  a  more  generally 
distributed  process.  We  also  note  that  eq(6.C.12)  can  continue  to  be  satisfied  by 
maintaining  the  relations 

R^(0)  =  R®  (0)  (6.C.13a) 

and 

H  QQ 

Ryv(0)  +  Ryy(0)  =  I.  (6.C.13b) 

This  can  be  seen  by  noting  that 
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(6.C.14a) 


E[Y(n)iiH(n)]  =  E  { [ii(n) + j  vq(ii)][s7 (n)  -  j  Yq(i)]  } 

=  [R^v(0)  +  Rw(O)]  +  j  [Ryi(O)  -  R^(0)].  (6.C.14b) 


Substituting  eqs(6.C.13)  into  (6.C.14b)  yields  (6.C.12).  We  emphasize  that 
eqs(6.C.13a)  and  (6.C.13b)  provide  a  more  general  condition  than  eqs(6.C.8a) 
and  (6.C.8b);  ie.,  the  quadrature  components  are  now  able  to  be  implemented 
with  an  arbitrary  cross-correlation. 

The  arbitrary  correlation  on  the  quadrature  components  of  y.(n)  could  be 
obtained  using 


Xj(n)' 

Xq(h) 


Bl(n)' 

BQ(n) 


where 

E[Brfn)EQ(n)]  -  [0] 

EtftCn^n)]  =  E[pQ(n)EQ(n)]  =  jl. 


We  now  consider 

E[ii(n)xJ(n)]  E^nteoCn)] 
E[2Q(n)Y?(n)]  E[YQ(n)XQ(n)] 

r  n  jo  n 
Ryy(0) 

=  QI  QQ 

yo)0°) 


(6.C.15) 


(6.C.16a) 

(6.C.16b) 


(6.C.17a) 


(6.C.17b) 


(6.C.17c) 


where  each  element  in  eq(6.C.17c)  is  a  JxJ  diagonal  matrix.  Using  eqs(6.C.15) 
through  (6.C.16b)  in  the  RHS  of  (6.C.17a) 
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rW0)=GE1  Lbq 


BQl  J 


so  that 


“|ggt 


n  io  “i 
RwrCO)  Ryy(O) 

QI  QQ  -  2 GGT- 

yo)C(°) 


(6.C.18a) 


(6.C.18b) 


(6.C.19) 


The  matrices  on  the  LHS  of  eq(6.C.19)  can  be  constrained  to  satisfy 
eqs(6.C.13a)  and  (6.C.13b)  without  loss  of  generality.  In  addition,  they  could  be 
specified  using  functional  forms  similar  to  eqs(3.C.5)  and  (3.C.8).  The  diagonal 

form  of  these  matrices  implies  that  correlation  only  exists  between  the  quadrature 
components  of  Y.g(n)  g=s,c  on  a  given  channel  and  not  across  channels. 

Therefore,  for  channels  i=l,2,...J,  we  would  use 
IQ  OI  IQ  n  QQ 

Ril  (0)  =  Rj|  (0)  =  lPifl  ay  G-p  i  =  1,2, ...J  (6.C.20) 

II  QQ 

where  Ojj  and  Gjj  are  the  standard  deviations  of  the  quadrature  components  on 

channel  i.  The  variances  on  each  channel  are  subject  to  the  constraint 

C^ii^n +  (aii)QQ 55  *  i  =  1,2,...J.  (6.C.21) 


Also, 


R,“(0)  =  (°H)n 


i  =  1,2,...J 


(6.C.22a) 


Rif(O)  =  «jfi)QQ 


i  =  1,2,...J. 


(6.C.22b) 


Finally,  eq(6.C.19)  can  be  solved  via  the  Cholesky  decomposition  to  obtain  G  and 
eq(6.C.15)  implemented  to  generate  yj(n)  and  iQ(n)  with  variable  correlation. 
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VH.  SYNTHESIS  RESULTS 
A.  Single  Channel  Case 

In  this  section,  we  utilize  the  AR  process  synthesis  procedure  described  in 
section  VI  to  generate  single  channel  autoregressive  processes  of  order  two. 
Using  the  Yule-Walker  equation,  two  AR  coefficients  are  obtained  which,  when 
substituted  into  the  scaler  form  of  eq(6.A.6),  provides  the  required  signal 
processes.  For  the  processes  shown  in  Figs  7.A.1  through  7.A.8,  the  real, 
Gaussian  autocorrelation  function  was  used.  We  note  that  an  AR(2)  process  has 
an  exponential  autocorrelation  function.  In  this  case,  we  are  generating  processes 
which  provide  a  'fit'  to  the  Gaussian  autocorrelation  function  in  a  MMSE  sense. 
We  also  note  that  in  this  case,  the  AR  coefficients  will  be  real.  However,  the 
processes  s(n)  generated  by  eq(6.A.6)  are  complex  since  u(n)  is  complex.  Also, 
the  resulting  spectra  will  be  even. 

In  Fig  7.A.1,  we  show  the  amplitude  of  the  real  part  of  the  signal  process 
with  order  two  using  a  temporal  correlation  coefficient  of  Xg=0.99  and  variances 
2 

as  ranging  from  2.0  to  8.0.  We  note  the  variation  in  the  amplitudes  of  each  plot 

as  the  variance  changes.  In  Fig  7.A.2,  we  show  the  amplitude  of  the  real  part  of 

2 

the  signal  using  a  variance  as=4.0  In  this  case,  however,  we  demonstrate  the 

effect  of  varying  the  temporal  correlation  coeffient  Xs  from  0.1  to  0.9999.  We 

note  that  Figs  7.A.2a  through  7.A.2c  are  plotted  for  100  samples,  while 
Fig.7.A.2d  uses  200  samples.  These  figures  illustrate  the  effect  of  Xs  in 

controlling  the  sample-to-sample  correlation.  It  is  apparent  that  as  Xs  approaches 

unity,  we  are  approaching  the  case  of  total  correlation  sample-to-sample; 
however,  as  Xg  goes  to  zero,  the  process  becomes  white.  It  is  worth  noting,  at  this 
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time,  that  die  imaginary  component  follows  the  same  behavior.  Recognizing  that 
the  signal  phase  is  expressed  as 

'sqOOI 


8s(n)  =  tan"1 


si(n) 


(7.A.1) 


then,  as  Xg  approaches  unity,  6s(n)  approaches  a  constant  since  Sj(n)  and  sg(n) 
are  approadiing  constant  values  within  a  single  trial.  On  the  other  hand,  as  Xs 
approaches  zero,  0s(n)  is  random  in  time  since  Sj(n)  and  sq(n)  exhibit  random 
behavior.  The  important  point  to  be  made  here  is  that  the  parameter  Xs  controls 


the  amplitude  correlation  as  well  as  the  phase  coherence  of  the  process.  This 
capability  will  be  utilized  to  demonstrate  coherent  integration  gain  in  detection 
performance  evaluations. 

In  Fig  7A.3,  we  show  results  for  three  separate  trials  of  the  real  part  of  the 

2 

signal  process  for  Xg  =  0.9999  and  a  =  4.0  over  200  time  samples.  The  point  to 


be  noted  here  is  the  randomness  associated  with  the  initial  amplitude  (and  phase 
via  the  previous  discussion).  As  noted,  however,  after  the  initial  amplitude  is 
selected  at  random,  the  remaining  samples  are  highly  correlated  within  each  trial 
as  governed  by  the  high  value  of  the  temporal  correlation  coefficient.  This 
feature  will  enable  us  to  model  processes  such  as  Swerling  fluctuating  signals!  14] 
in  radar  applications,  for  example. 

Fig  7.A.4  shows  the  results  of  the  model  fitting  procedure.  The  dotted 
curves  plot  the  correlation  functions  predetermined  by  the  functional  shaping 
method.  The  solid  curves  are  plots  of  the  correlation  funcion  calculated  using 

10,000  samples  of  the  process  over  40  lag  values.  Figs  7.A.4a,  7.A.4b  and 
7.A.4c  are  plots  for  Xs  =  0.95,  0.8,  and  1.0,  respectively.  We  first  note  the  effect 

of  Xs  on  the  correlation  function;  ie.  as  Xs  transitions  from  unity  to  zero,  the 
correlation  function  ranges  from  that  of  a  slowly  varying  function  of  the  lag 
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value  to  that  of  a  delta  function.  Next,  we  note  from  Figs  7.A.4a  and  7.A.4b  that 
the  plots  of  the  AR  process  of  order  two  provide  a  fit  to  the  predetermined 
correlation  function.  This  is  a  result  of  the  fact  that  it  would  require  an  AR 
process  of  infinite  order  to  model  the  Gaussian  correlation  process  exactly. 
These  plots  illustrate  that  the  processes  generated  here  are  an  approximation  to 
those  of  the  predetermined  correlation  function.  In  fact,  they  are  the  processes 
that  fit  the  known  model  in  a  MMSE  sense.  In  Fig  7.A.5,  we  show  the 
autoregressive  power  spectral  density  (ARPSD)  which  is  obtained  using  the  AR 
coefficients  obtained  from  the  Yule-Walker  equation.  Fig  7.A.6  is  the 
corresponding  power  spectral  density  (PSD)  determined  using  a  zero-filled  64 
point  FFT  of  the  calculated  correlation  functions  plotted  in  Fig  7.A.4.  The  plots 
for  Figs  7.A.6a  and  7.A.6b,  show  even  spectra;  however,  we  also  note  the  dual 

peaks  associated  with  the  poles  of  the  AR(2)  model.  The  obvious  point  to  be 
noted  here  is  the  behavior  of  the  spectra  for  various  values  of  Xs;  ie.  as  A.s  ranges 

from  unity  to  zero,  the  spectra  transitions  from  its  peaked  behavior  to  the  broad 

distribution  associated  with  white  noise  processes.  It  is  also  interesting  to  note 
that  as  Xs  decreases,  the  pronounced  pole  positions  are  diminished  as  shown  in 

Fig  7.A.6c.  This  is  a  result  of  the  fact  that  the  AR  coefficients  are  becoming 
vanishingly  small  as  noted  by  eqs(6.A.9)  and  (6. A.  10). 

In  Figs  7.A.7  and  7.A.8,  we  show  plots  of  the  autocorrelation  function  and 
power  spectral  density,  respectively,  again  using  10,000  samples  of  the  same 
signal  process,  but  in  the  presence  of  unit  variance  additive  white  noise.  We  note 
that  the  correlation  functions  in  Fig  7.A.7  overlay  the  corresponding  functions 
shown  in  Fig  7.A.4  except  that  at  lag  zero,  they  have  increased  by  a  unit  value 
due  to  the  uncorrelated  noise  process.  A  comparison  of  Figs  7.A.6  and  7.A.8 
shows  the  increased  levels  due  to  the  additive  noise. 
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B.  Multichannel  Case 

In  this  section,  we  consider  the  generation  of  a  two  channel  vector  process 
using  the  AR  synthesis  approach  described  in  section  VI.  In  this  case,  the 
multichannel  Yule-Walker  equation  is  solved  for  the  forward  AR  matrix 
coefficients  and  the  forward  driving  white  noise  covariance  matrix.  These 
matrices  are  used  in  eq(6.A.6)  and  (6.A.7)  for  process  generation.  We  limit  the 
results  shown  here  to  the  case  of  real,  Gaussian  correlation  functions.  In  sections 
Vn.C  and  VII.D,  we  will  quantitatively  assess  the  ergodicity  considerations 
developed  in  section  IV.  In  this  section,  however,  we  will  note  several  qualitative 
indications  of  the  dependence  of  ergodicity  on  the  correlation  parameters. 

Table  7.B.1  contains  the  parameters  used  in  the  auto-  and  cross-correlation 
functions  described  in  eqs(3.C.13a)  and  (3.C.23b).  The  resulting  values  are  then 
used  in  the  correlation  matqx  of  the  multichannel  Yule-Walker  equation  to  solve 
for  the  coefficients  C  and  A(k)  k  =  1,2.  The  resulting  AR  coefficient  matrices 
are  listed  in  Table  7.B.2.  We  will  discuss  these  quantities  later  to  gain  further 
insight  into  the  process  generation  procedure. 

Figs  7.B.1  through  7.B.4  contain  the  results  for  processes  with  high 
temporal  correlation  on  each  channel.  In  Fig  7.B.1,  Xjj  =  0.9999  on  both 
channels  with  Ip  ^  21=0.95.  In  Figs  7.B.2  through  7.B.4,  Xjj  =  0.95  on  both 
channels,  while  the  cross-correlation  coefficient  Ip^l  ranges  from  0.99  to  0.0. 

Figs  7.B.la  and  7.B.lb  show  200  sample  observations  of  the  synthesized 

processes  for  channels  1  and  2,  respectively,  for  one  realization.  A  second 

realization  is  shown  in  Figs  7.B.lc  and  7.B.ld.  A  visual  inspection  of  these  two 

trials  reveals  the  relatively  high  degree  of  cross-correlation  between  the  two 
channels  controlled  by  Ip  j  21=0.95.  Figs  7.B.le  and  7.B.lf  show  the 

corresponding  ensemble  averaged  autocorrelation  functions  calculated  using 
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4 
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0.95 
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7.B.5 

AR(2) 

4 

4 

0.0 

0.80 

0.80 

arbitrary*  0 

0.0 

7.B.6 

AR(2) 

4 

4 

0.0 

0.40 

0.40 

arbitrary*  0 

0.0 

7.B.7 

AR(2) 

4 

4 

0.99 

0.10 

0.10 

0.10  0 

3.96 

7.B.8 

AR(2) 

4 

4 

0.30 

0.10 

0.10 

0.97  0 

1.2 

7.B.9 

AR(2) 

4 

4 

0.10 

0.10 

0.10 

0.20  0 

0.4 

7.B.10 

AR(2) 

4 

4 

0.50 

0.95 

0.10 

0.97  0 

2.0 

7.B.11 

AR(2) 

4 

1 

0.40 

0.95 

0.10 

0.97  4 

0.8 

7.B.12 

AR(4) 

4 

1 

0.30 

0.95 

0.10 

0.97  4 

0.6 

Table  7.B.1 


*  Examination  of  eq(3.C.23b)  indicates  that  for  Ipj2*  =0*  the  value  of  Xj2  is  arbitrary. 


1,000  trials.  We  note  that  in  Fig  7.B.lf,  the  experimentally  obtained  cross¬ 
correlation  function  evaluated  for  lag  zero  fell  somewhat  below  the  process 
variance  of  4.  The  reason  for  this  will  be  explained  below.  An  overlay  of  six 
realizations  of  die  corresponding  time-averaged,  biased,  autocorrelation  function 
for  each  channel  is  shown  in  Figs  7.B.lg  and  7.B.lh,  respectively.  In  these  plots 
10,000  time  sample  observations  were  used  to  estimate  the  functions  over  64  lag 
values.  Figs  7.B.li  and  7.B.lj  show  the  temporal-  averaged  and  ensemble 
averaged  cross-correlation  functions,  respectively.  Inspection  of  plots  g  and  h 
indicates  that  the  six  realizations  of  the  estimated  time-averaged  autocorrelation 
functions,  each  based  on  10,000  time  observations,  vary  considerably  from  trial- 
to-trial.  This  implies  that  the  variance  of  the  time-averaged  autocorrelation 
functions  is  large.  Likewise,  this  same  behavior  is  noted  for  the  time  averaged 
cross-correlation  function  in  plot  i.  These  results  provide  an  indication  that 

ergodicity  cannot  be  assumed  to  hold  in  this  case  even  though  the  number  of 
observations  NT  is  as  high  as  10,000;  ie.,  the  estimates  of  the  auto-  and  cross¬ 
correlation  functions  obtained  by  time  averaging  over  a  single  realization  will,  in 

general,  differ  considerably  from  the  ensemble  averaged  value  when  the  temporal 
correlation  coefficients  are  high. 

In  Fig  7.B.2,  the  cross-correlation  coefficient  is  increased  slightly  to  0.99 
while  the  temporal  correlation  coefficients  are  reduced  to  0.95  on  both  channels. 
Fig  7.B.2  shows  the  same  data  displays  as  Fig  7.B.I.  We  note  in  plots  a  and  b, 
that  both  channel  processes  have  become  more  uncorrelated  in  time  as  evidenced 
by  their  more  rapid  temporal  fluctuation.  However,  we  also  note  the  high  cross¬ 
correlation  between  the  channel  processes;  ie.,  both  waveforms  are  nearly 

identical  (note  the  scale  change  on  the  plots  a  and  b).  This  high  correlation 
results  from  the  high  value  of  Again,  plots  e  and  f  show  the 
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Fig.  7.B.1  Two  channel  AR(2)  processes  a.)  channel  1  data  (trial  1)  b.) 
channel  2  data  (trial  1)  c.)  channel  1  data  (trial  2)  d.)  channel  2  data  (trial  2) 
e.)  ensemble  averaged  channel  1  autocorrelation  (1,000  realizations)  f.) 
ensemble  averaged  channel  2  autocorrelation  (1,000  realizations). 


Fig.  7.B.2  Two  channel  AR(2)  processes  a.)  channel  1  data  (trial  1)  b.) 
channel  2  data  (trial  1)  c.)  channel  1  data  (trial  2)  d.)  channel  2  data  (trial  2) 
e.)  ensemble  averaged  channel  1  autocorrelation  (1,000  realizations)  f) 
ensemble  averaged  channel  2  autocorrelation  (1,000  realizations). 


•  • 

1  J 

Fig;  7.B.2  (contin.)  g.)  time-averaged  channel  1  autocorrelation  (6  trials) 
h.)time  averaged  channel  2  autocorrelation  (6  trials)  i.)  time-averaged  cross- 

correlation  (6  trials)  j.)  ensemble  averaged  cross-correlation  (10,000 
realizations). 
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ensemble  averaged  autocorrelation  functions  for  each  channel.  Six  realizations  of 
the  corresponding  time-averaged  autocorrelation  functions  shown  in  plots  g  and  h 
show  a  significant  decrease  in  the  variance  of  these  functions  as  compared  to  the 
previous  figure.  Likewise  the  six  realizations  of  the  time-averaged  cross¬ 
correlation  function  in  plot  i  also  show  a  reduction  in  their  variance. 

In  Fig  7.B.3  and  7.B.4,  the  temporal  correlation  coefficients  are  held  at 
0.95  as  in  7.B.2;  however,  the  cross-correlation  coefficient  is  reduced  to  0.5  and 
0.0,  respectively.  In  each  of  these  figures,  plots  a  and  b  show  a  single  realization 
of  200  sample  observations.  An  overlay  of  six  corresponding  temporally- 
averaged  autocorrelation  functions,  based  on  10,000  time  sample  observations 
each,  is  shown  in  plots  c  and  d.  Six  trials  of  the  temporal- averaged  cross- 
correlation  function  are  shown  in  plot  e,  while  the  corresponding  ensemble 
averaged  result,  based  on  10,000  realizations,  is  shown  in  plot  f.  A  visual 
comparison  of  the  temporally-averaged  autocorrelation  functions  in  Figs 

7.B.2g,h,  7.B.3c,d  and  7.B.4c,d  indicates  that  the  variance  associated  with  these 
plots  appears  to  remain  constant.  Again,  we  note  that  X^  ^  and  have 

remained  constant,  although  Ip  12*  has  changed  significantly.  Close  examination 

of  the  scale  levels  for  the  temporally  averaged  cross-correlation  functions  among 
these  figures  indicates  that  the  variance  of  this  function  has  not  changed.  We  will 
discuss  this  point  further  in  section  VII.D. 

The  cross-correlation  coefficient  is  held  at  zero  in  Figs  7.B.5  and  7.B.6, 
while  the  temporal  correlation  coefficients  are  decreased  to  0.8  and  0.4, 
respectively.  Plots  a  and  b  for  Figs  7.B.4,  7.B.5  and  7.B.6  show  the  effect  of  the 

decreasing  temporal  correlation;  ie.,  the  processes  are  becoming  more  whitened 
as  decreases.  The  resulting  autocorrelation  functions  shown  in  plots  c  and  d 

for  these  cases  also  reflect  this  trend  by  approaching  a  delta  function  as  A.jj 
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Fig.  7.B.3  Two  channel  AR(2)  processes  a.)  channel  1  data  b.)  channel  2  data 
c.)  time-averaged  channel  1  autocorrelation  (6  trials)  d.)  time-averaged  channel 
2  autocorrelation  (6  trials)  e.)  time-averaged  cross-correlation  (6  trials)  f.) 
ensemble  averaged  cross-correlation  (10,000  realizations). 
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Fig.  7.B.4  Two  channel  AR(2)  processes  a.)  channel  1  data  b.)  channel  2  data 
c.)  time-averaged  channel  1  autocorrelation  (6  trials)  d.)  time-averaged  channel 
2  autocorrelation  (6  trials)  e.)  time-averaged  cross-correlation  (4  trials)  f.) 
ensemble  averaged  cross-correlation  (10,000  realizations). 


II 


e  f 

Fig.  7.B.5  Two  channel  AR(2)  processes  a.)  channel  1  data  b.)  channel  2  data 
c.)  time-averaged  channel  1  autocorrelation  (6  trials)  d.)  time-averaged  channel 
2  autocorrelation  (6  trials)  e.)  time-averaged  cross-correlation  (6  trials)  f.) 
ensemble  averaged  cross-correlation  (10,000  realizations). 


Fig.  7.B.6  Two  channel  AR(2)  processes  a.)  channel  1  data  b.)  channel  2  data 
c.)  time-averaged  channel  1  autocorrelation  (6  trials)  d.)  time-averaged  channel 
2  autocorrelation  (6  trials)  e.)  time-averaged  cross-correlation  (6  trials)  f.) 
ensemble  averaged  cross-correlation  (10,000  realizations). 


decreases.  Close  examination  of  plot  e  in  each  of  these  figures  provides  some 
indication  that  the  variance  of  the  cross-correlation  function  decreases  as  l  ^ 

X22  decrease. 

In  Figs  7.B.7  through  7.B.12,  similar  plots  are  shown.  Fig  7.B.7  shows  the 

case  of  two  noisy  processes  which  are  highly  correlated.  In  Fig  7.B.8,  the 
temporal  cross-correlation  coefficient  is  raised  to  0.97.  The  value  of  Ip^l 

was  lowered  to  0.3  in  order  to  satisfy  the  positive  semi-definiteness  constraint 
condition.  We  note  that  in  the  expanded  view  of  the  cross-correlation  function 
displayed  in  Fig  7.B.8f,  the  resulting  estimated  values  at  these  lags  remain  high 
out  to  the  lag  value  of  2.  Beyond  I  =  2,  however,  the  cross-correlation  function 
drops  significantly.  This  result  will  be  discussed  later.  Fig  7.B.10  shows  the 
interesting  result  obtained  when  the  noisy  signal  on  channel  2  is  required  to  be 
correlated  with  the  high  temporally  correlated  channel  1  process.  Fig  7.B.10c 
shows  an  overlay  of  the  two  distributions  shown  in  plots  a  and  b.  As  this  figure 
indicates,  the  noisy  channel  2  process  appears  as  a  modulation  on  the  channel  1 
process.  It  is  also  noted  that  the  autocorrelation  functions  for  each  channel  have 
maxima  and  minima  which  occur  at  the  same  lag  values.  In  addition,  an 
interesting  peak  occurs  at  the  third  lag  value  in  plot  e.  We  will  consider  this 
later. 

Finally,  we  consider  the  results  shown  in  Figs  7.B.11  and  7.B.12,  where 
Il2  is  specified  to  be  4.  In  these  figures,  we  use  AR(2)  and  AR(4)  processes, 

respectively.  Plots  a  and  b  in  each  figure  show  200  samples  of  the  processes.  As 
in  the  previous  case,  the  difference  in  temporal  correlation  on  each  channel  is 
noted.  The  overlay  in  Fig  7.B.llc  shows  the  effect  of  the  distinct  variances  on 
each  channel  as  well  as  the  moderate  amount  of  cross-correlation.  Six 
realizations  of  the  corresponding  autocorrelation  functions  are  shown  in  plots  d 
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Fig.  7.B.7  Two  channel  AR(2)  processes  a.)  channel  1  data  b.)  channel  2 
data  c.)  time-averaged  channel  1  autocorrelation  (6  trials)  d.)  time- 
averaged  channel  2  autocorrelation  (6  trials)  e.)  time-averaged  cross¬ 
correlation  (6  trials). 
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Fig.  7J3.8  Two  channel  AR(2)  processes  a.)  channel  1  data  b.)  channel  2  data 
c.)  tone-averaged  channel  1  autocorrelation  (6  trials)  d.)  time-averaged  channel 
2  autocorrelation  (6  trials)  e.)  time-averaged  cross-correlation  (64  lags-6  trials) 
f.)  tone-averaged  cross-correlation  (6  lags-6trials). 
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Fig.  7.B.9  Two  channel  AR(2)  processes  a.)  channel  1  data  b.)  channel  2  data 
c.)  tune-averaged  channel  1  autocorrelation  (6  trials)  d.)  time-averaged  channel 
2  autocorrelation  (6  trials)  e.)  time-averaged  cross-correlation  (64  lags-6  trials) 
f.)  tune-averaged  cross-correlation  (6  lags-6trials). 


Fig.  7.B.10  Two  channel  AR(2)  processes  a.)  channel  1  data  b.)  channel  2  data 
c.)  overlay  of  channels  1  and  2  d.)  time-averaged  channel  1  auto-  correlation  (6 
trials)  e.)  time-averaged  channel  2  autocorrelation  (6  trials). 


f 


g 


Fig  7.B.10  (contin.)  f.)  time-averaged  cross-correlation  (64  lags-6trials)  g.) 
time-averaged  cross-correlation  (6  lags-6 trials). 
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Fig.  73.11  Two  channel  AR(2)  processes  a.)  channel  1  data  b.)  channel  2  data 
c.)  overlay  of  channels  1  and  2  d.)  time-averaged  channel  1  auto-  correlation  (6 
trials)  e.)  time-averaged  channel  2  autocorrelation  (6  trials). 
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Fig  7.B.11  (contin.)  f.)  time-averaged  cross-correlation  (64  lags-6trials)  g.) 
time-averaged  cross-correlation  (6  lags-6trials). 


Fig.  7.B.12  Two  channel  AR(4)  processes  a.)  channel  1  data  b.)  channel  2  data 
c.)  tune-averaged  channel  1  autocorrelation  (6  trials)  d.)  time-  averaged  channel 
2  autocorrelation  (6  trials)  e.)  time-averaged  cross-  correlation  (64  lags-6 
trials)  f.)  time-averaged  cross-correlation  (8  lags-6trials). 


and  e  for  Fig  7.B.11  and  plots  c  and  d  for  Fig  7.B.12.  The  cross-correlation 

functions  (six  realizations)  are  displayed  in  the  last  two  plots  in  each  figure  for  64 

and  8  lag  values,  respectively.  We  note  that  in  Fig  7.B.llg,  the  cross-correlation 
function  peaks  at  a  lag  value  of  1^  =  2  rather  than  ^2  =  ^8  7.B.12f, 

however,  we  note  that  for  the  AR(4)  process,  the  cross-correlation  function  does 
peak  at  1^2  =  4.  We  also  mention  that  in  the  case  of  the  AR(4)  process  described 

in  Fig  7.B.12,  the  parameter  Ip  ^  had  to  be  lowered  to  the  value  of  0.3.  This 

was  necessary  to  maintain  the  positive  semi-definiteness  requirement.  Finally,  in 

plots  c  and  d  for  Fig  7.B.12,  we  again  note  that  the  maxima  and  minima  occur  at 

the  same  lag  values.  In  addition,  we  note  that  for  this  AR(4)  process,  the  peak 

values  of  the  channel  2  autocorrelation  function  follow  the  shape  of  the  channel  1 

autocorrelation  function.  The  rapid  decrease  in  this  function  between  the  peak 

values  is  a  measure  of  the  'noisy'  channel  2  process.  The  periodic  peak  values, 

however,  are  a  measure  of  the  correlation  on  this  channel  resulting  from  its 
moderate  degree  of  cross-correlation  (ie.,  Ip  ^  21=0.3)  with  the  high  temporally 

correlated  channel  1  process. 

Considerable  insight  into  the  process  generation  scheme  can  be  obtained  by 
examining  the  coefficients  in  Table  7.B.2  which  were  determined  from  a  solution 
of  the  Yule-Walker  equation.  For  Fig  7.B.1,  we  first  note  that  the  white  noise 
driving  covariance  matrix  C  has  very  low  values  compared  to  those  in  the  A(l) 
and  A(2)  matrices.  This  will  cause  the  resulting  processes  to  be  highly  dependent 
upon  the  past  data  samples  with  minimal  dependence  upon  the  driving  white  noise 

vector.  This  increases  the  temporal  correlation  on  the  channel  processes.  In 
addition,  the  c^  and  C21  elements  of  this  matrix  are  approximately  equal,  while 

C44  is  much  smaller.  This  will  cause  the  elements  of  the  vector  u(n)  in  eq(7.A.7) 
to  be  nearly  identical,  thus  contributing  to  the  high  cross-correlation.  We  again 
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point  out  that  in  this  case  of  high  temporal  correlation,  the  C  matrix  has  small 
values.  This  will  cause  the  variance  of  the  white  noise  driving  term  to  be  small. 
If  the  overall  variance  of  the  process  is  required  to  be  large,  the  synthesis  process 
must  be  operated  over  a  long  initial  transient  period  to  allow  the  processes  to 
reach  sufficient  magnitude.  For  this  case,  only  2,000  initial  samples  were 
generated  before  saving.  This  quantity  was  not  sufficient  and  thus  the  low  values 
shown  in  Fig  7.B.lf  resulted. 

In  Fig  7.B.2,  the  and  C21  elements  are  again  nearly  equal  and  much 
greater  than  C44  so  that  the  very  high  cross-correlation  is  obtained.  We  note, 

however,  that  all  the  C  matrix  elements  have  increased  as  compared  to  the 

previous  case.  This  will  cause  the  additive  white  noise  driving  variance  to  have  a 

more  significant  effect  on  the  resulting  process.  As  a  result,  temporal  correlation 
on  each  channel  will  decrease  as  expected  since  the  1  and  X22  values  have  been 

decreased. 

In  Figs  7.B.4,  we  note  that  only  cn  and  c44  are  non-zero.  This  will  cause 

the  vector  u(n)  to  have  totally  uncorrelated  elements,  thus  providing  no  cross- 
correlation  as  required  since  lp12l=0.  Examination  of  these  elements  for 

Figs7.B.4  through  7.B.8  shows  the  increasing  significance  of  the  white  noise 
driving  term  relative  to  the  past  values;  ie.,  the  C  matrix  eventually  begins  to 
weight  the  white  noise  vector  y(n)  higher  than  the  A(k)  k=l,2  matrices  weight  the 
past  samples.  Thus,  the  temporal  correlation  decreases. 
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Fig. 
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7.B.4 
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7.B.10 

7.B.11 

7.B.12 
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A(2) 

C 
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L  0.0049  0.0015. 

:] 


A(3) 
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.789-0.154 
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]  r  0.789  -0.154] 

J  L  0.545  0.321  J 


A(4) 

0.698  -0.0384 
.2.085  0.452  J 


T  0.269  0.0  ] 
L  0.266  0.038  J 

r  0.265  0.0  ] 
L  0.066  0.257  J 
r  0.269  0.0  ] 
L  0.0  0.269  J 
r  0.922  0.0  ] 
L  0.0  0.922  J 

[ 

[ 

r  1.82  0.0  ] 

LO.74  0.166 J 
r  1.989  0.0  ] 
L  0.195  1 .980  J 
f*  0.261  0.0  ] 
L  0.521  1.519  J 
T0.213  0.0  ] 
L  0.639  0.608  J 


1.81  0.0 
0.0  1.81  J 
1.99  0.0 
1.97  0.281  J 


r  3.974  -0.0386' 

0.0665  0.0  ' 

L -8.2604  0.4039  . 

.0.5798  0.5834. 

Table  7.B.2 
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For  the  matrix  elements  corresponding  to  the  Fig  7.B.8  results,  we  make 

the  following  observations.  First,  the  relatively  high  values  of  the  C  matrix 

elements  compared  to  the  A(k)  matrices  again  provides  emphasis  on  the  white 

noise  driving  term.  Second,  the  relatively  high  and  equal  off-diagonal  elements 

of  the  two  A(k)  matrices  provides  high  cross-correlation  with  respect  to  the  two 
past  sample  values.  This  result  is  controlled  by  the  high  value  of  X12=0.97. 

Third,  the  value  lp12l=0.3  has  a  significant  effect  on  the  c21  element.  It  is  near 

the  uppermost  value  for  the  cross -correlation  coefficient  that  can  be  obtained 

under  the  constraint  condition  of  positive  semi-definiteness.  The  result  is  that  the 

white  noise  vector  is  provided  a  moderately  high  cross-correlation.  This  case  can 

be  contrasted  with  the  coefficients  for  Fig  7.B.9.  In  this  case,  the  low  value  of 
A.12=0.2  and  lp12l=0.1  causes  the  off-diagonal  elements  in  the  A(k)  matrices  and 

the  C2|to  decrease  significantly. 
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C.  The  Autocorrelation  Function  Ergodicity  Results 

In  this  section,  we  will  evaluate  the  ergodicity  of  the  autocorrelation 

function.  This  will  be  accomplished  by  evaluating  the  variance  of  the  time- 

averaged  autocorrelation  function  as  determined  by  its  ergodic  series.  In  section 

IV A,  we  developed  the  expression  described  by  eq(4.A.15).  In  that  case,  the 
time-averaged  autocorrelation  function  RftT(l)  was  estimated  using  eq(4.A.l).  In 

practice,  however,  we  use  expressions  such  as  the  estimator 

nt-i-i 

M  X  Xi(n)Xi  (n-l)  0  <1  <Nt-1 

n=0 

(7.C.1) 

Nrll|-1 

^  X  xi(n)xi(n-,l|)  -(Nt-1)<I  <  0. 
n=0 

For  M  =  NT  ,  we  obtain  the  biased  estimator  while  for  M  =  NT  -  I,  we  have  the 

unbiased  estimator.  In  Appendix  B,  we  derive  the  expression  for  the  variance  of 
the  biased  estimator  and  obtain 

Nt-II|-1 

VBii(I.NT)  =  if  I  [  1  -  'irrl  CM(k,l)  (7.C.2a) 

"  T  k=-(Nrll|-l) L  TJ 

Nt-II|-1 

=  if  X  f1  ■"'Nr![lRii(k)|2  +  Re(Fii<l’k))]  <7’C2b> 

T  k=-(NT-ll|-l)L  T  J  J 

In  the  case  where  Fjj(l Jc)=0,  the  form  of  eq(7.C.2b)  indicates  that  VB..(I) 

decreases  as  a  function  of  lag  I.  This  results  from  the  decreasing  number  of 
positive  terms  in  the  summation  as  well  as  the  decrease  in  the  first  bracketed  term 
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as  lag  I  increases.  This  is  to  be  contrasted  with  the  form  of  eq(4.A.18)  where  the 
variance  at  each  lag  value  was  determined  using  the  same  number  of  sample 

values.  As  a  result,  eq(4.A.18)  provided  a  constant  variance  independent  of  I 
when  Fjj(l,k)=0.  Finally,  in  [7]  it  is  noted  that  the  variance  of  the  unbiased 

estimator  may  increase  as  a  function  of  I  since  this  variance  expression  has  the 
term  jjj  before  the  summation. 

In  this  section,  we  will  consider  the  special  case  of  the  real,  exponentially 
shaped  autocorrelation  function,  and  synthesize  an  AR(1)  process.  The  real 
AR(1)  process  also  has  an  exponential  autocorrelation  function  expressed  as 


RAR(k)  =  RAR(0)[-a(l)]lkl 

(7.C.3a) 

=  <4  [-*1)]“ 

(7.C.3b) 

where 

L 

°u 

RAr(°)=  1  .  a2(l)  =  CTAR 

(7.C.4) 

2  2 

and  au  ,  a(l)  and  oAR  are  the  white  noise  driving  variance,  the  AR(1)  parameter. 

and  the  variance  of  the  AR(1)  process,  respectively. 
Yule-Walker  equation  where 

Eq(7.C.4)  follows  from  the 

°U  =  RAr(°)  +  a(l)RAR(-l) 

(7.C.5a) 

=  °AR  "  a2U)  °AR 

(7.C.5b) 

=  Oar  » -  a2(l)]. 

(7.C.5c) 
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With 

-a(l)  =  XAR  (7.C.6) 

we  have 

RAR®  =  °L^AR]lkl-  (7.C.7) 

Therefore,  in  this  special  case,  the  AR(1)  autocorrelation  function  is  equivalent  to 
the  autocorrelation  function  used  in  the  correlation  matrix  of  the  Yule-Walker 
eq(6.A.l).  In  section  IV,  the  functional  form  of  the  autocorrelation  function 
expressed  by  eq(4.A.19)  was  used  in  eq(4.A.18).  We  note  that  this 
autocorrelation  function  is  the  function  to  which  the  synthesized  processes  are 
providing  a  best  'fit'.  If,  however,  we  are  attempting  to  validate  an  analytic 
expression  for  eq(4.A.18)  or  eq(7.C.2b)  using  the  synthesized  AR  processes,  we 
must  use  the  form  for  the  AR  autocorrelation  function  in  this  expression  rather 
than  the  functional  form  which  we  are  attempting  to  'fit'.  In  general,  the  AR 
autocorrelation  functions  are  a  rather  complicated  function  of  the  AR 

parametersfll].  In  the  case  of  the  AR(1)  process,  however,  we  use  eq(7.C.7)  in 
(7.C.2b).  We  also  note  that  in  the  case  where  Rjj(a)  is  real,  the  in-phase  and 

quadrature  components  of  the  synthesized  outputs  are  uncorrclated  (see  Appendix 
F)  so  that 

Rjf(a)  =  R-f(a)  =  0  all  a.  (7.C.8) 

In  Appendix  F,  we  also  show  that  in  this  case 

R?(a)  =  Rjj^(a)  all  a  (7.C.9a) 
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(7.C.9b) 


and  at  a  =  0 

it  QQ  2 
Rii(O)  =  Rh  (0)  =  afj  /  2. 

Using  these  equations  in  eqs(4.A.17a)  and  (4.A.17b),  we  have 

Re{Fii(U)}  =0  all  l,k.  (7.C.10) 

From  eq(7.C.7),  eq(7.C.2b)  becomes 


vBii(l-Nr)  =  FT  I„  [l  -  "W\  lRii«|2 
11  Tk=-(N X-II|-1)L  TJ 


(7.C.lla) 


NT-II|-1 

mHl  2  [1-"-Hf]alR^AR)2lkl-  (7.C.llb) 

Tk=-(NT-ll|-l)L  T  J 


Eq(7.C.l  lb)  is  an  analytic  expression  for  the  variance  of  the  time-averaged 
autocorrelation  function  of  the  AR(1)  process  considered  in  this  case.  We  now 

consider  the  expression  used  to  calculate  this  variance  with  the  synthesized  data. 
Consider  NR  realizations  of  the  random  process  xj(n).  Let  each  realization  be 

indexed  by  the  integer  a;  a=l,2,...,NR.  Corresponding  to  the  realization  with 

index  a,  let  ftiir^(l,NT|a)  be  the  biased,  time-averaged  cross-correlation  function 

estimate  using  N-j-  observation  samples.  The  sample  variance  of  the  time-averaged 
cross-correlation  function  estimates  is  computed  from  NR  realizations  using  the 

expression 

Nr 

Var[ftiiTb(l,NT):NR]  =  f  1 1£ iiTb(l,NT|a)  -  ftiiTb(l,NRla)l2  (7.C.12) 


where 


Nr 

^iiTuO»NRla)  =  X  ^uTu^’NtI0)' 

K  a=l 


(7.C.13) 
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In  Fig  7.C.1,  the  maximum  value  of  Vb..(I,Nj),  which  occurs  at  1*0,  is 

plotted  (solid  curves)  as  a  function  of  X^X^  for  NT  *100  and  NT  *1000  using 

the  analytic  expression  of  eq(7.C.llb).  The  corresponding  sample  variances  of 
the  time-averaged  autocorrelation  function  estimates  computed  by  eq(7.C.12)  at 

lag  zero  using  dre  synthesized  data  processes  are  also  plotted  (•)  on  this  curve. 
These  values  were  computed  using  NR  realizations  of  die  autocorrelation  function 

estimates.  For  N-j-  *100,  NR*10,000  was  used  while  for  Nj  *1000,  the  number  . 

of  realizations  was  reduced  to  NR* 1,000. 


Fig  7.C.1  Maximum  variance  of  the  time-averaged  exponentially  shaped 

2 

autocorrelation  function  versus  Xjj  with  0ii*4;  analytical^)  and  computed(»). 
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Table  7.C.1  contains  the  parameters  used  in  the  process  synthesis  procedure 
as  well  as  the  values  of  NT  and  NR  for  the  sample  variance  calculation.  In  these 

2 

cases,  the  variance  of  the  process  c-  was  held  fixed  at  4  while  was  varied 
from  0.1  to  0.99. 

Figs  7.C.2  through  7.C.11  show  the  results  for  these  variances  based  on  the 
computed  values  of  eq(7.C.12)  and  the  analytic  expression  of  eq(7.C.llb).  In 

plot  a  of  Fig  7.C.2,  we  show  six  realizations  of  the  biased,  time-averaged 
autocorrelation  function  plotted  over  64  lag  values  using  NT=100  time  samples. 

The  corresponding  ensemble  averaged  result  is  shown  in  plot  b  using  NR= 10,000. 

The  sample  variance  of  the  biased  time-averaged  autocorrelation  function  plotted 
in  a  is  displayed  in  c.  These  values  were  computed  using  eq(7.C.12)  with 

Nr=10,000.  The  corresponding  analytic  calculation  using  eq(7.C.llb)  is  shown 

in  plot  d.  In  plot  e,  we  show  the  corresponding  sample  variance  using  the 
unbiased  estimate  of  the  autocorrelation  function.  As  noted  previously,  the 
variance  of  the  biased  autocorrelation  function  decreases  with  I  while  that  for  the 
unbiased  function  may  increase.  This  behavior  is  illustrated  in  plots  c,  d  and  e 
and  is  also  noted  in  Fig  5.12  of  ref  [7].  In  plots  f,  g,  h  and  i,  we  show  the 

ensemble  averaged  quadrature  correlation  functions  estimated  from  the 
synthesized  process  using  NR= 10,000.  Examination  of  these  plots  validates 

eqs(7.C.8),  (7.C.9a)  and  (7.C.9b)  recognizing  that  a  finite  number  of  realizations 
were  used  in  the  computations. 

In  Figs  7.C.3  through  7.C.6,  we  show  results  similar  to  those  described  in 
Fig  7.C.2  (although  the  unbiased  variance  is  no  longer  considered).  In  Fig  7.C.7 
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0.99 

Table  7.C.1 
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through  7.C.11,  we  show  the  results  corresponding  to  plots  a,  b,  c  and  d  in  the 
previous  figures  using  Nj=1000  and  Nr=1000. 

A  comparison  of  plot  a  in  each  of  these  figures  graphically  illustrates  the 
increase  in  the  variance  of  the  time-averaged  autocorrelation  function  as  A.jj 

approaches  unity.  In  addition,  a  comparison  of  the  figures  corresponding  to  a 
specific  value  of  shows  the  decrease  in  this  variance  as  Nj  increases.  The 

plots  shown  in  Fig  7.C.1  summarize  the  results  shown  in  these  figures. 
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7.C.2  Time-averaged  autocorrelatioQ  function  and  its  variance  for  X»0.1  and 

as«4  a.)  biased  Rj(l)  (6  trials)  using  N-p-lOO  b.)  ensemble  averaged  RE(I)  using 

10,000  realizations  c.)  sample  variance  of  the  biased  Rj(l)  d.)  analytical  variance 
of  biased  R^l)  e.)  sample  variance  of  the  unbiased  Rj(l). 
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Fig  7.C.3  (conlin.)  Ensemble-averaged  quadrature  correlation  function  for  X=0.5,  Nj=100  and  10,000 
realizations  e.)  r”(I)  f.)  R^l)  g.)  R^(l)  h.)  R^(l). 


biased  RjO)  d.)  analytical  variance  of  biased  Rj<l). 


Fig  7.C.4  (contin.)  Ensemble-averaged  quadrature  correlation  function  for  k=0.7,  Nj=100  and  10,000 
realizations  c.)  Rg(l)  f.)  Rg^(l)  g.)  rJP(I)  h.)  Rj?(l). 


biased  Rj(l)  d.)  analytical  variance  of  biased  R^p(l). 


Pig  7.C.7  Time-averaged  autocorrelation  function  and  its  variance  for  X=0.1  and  os=4  a.)  biased  R^O) 

(6  trials)  using  Nj= 1 ,000  b.)  ensemble  averaged  Rg(l)  using  10,000  realizations  c.)  sample  variance  of 
the  biased  Rj(l)  d.)  analytical  variance  of  biased  R^CI). 


Fig  7.C.8  Time-averaged  autocorrelation  function  and  its  variance  for  X=0.5  and  as=4  a.)  biased  Rj(l) 

(6  trials)  using  Nj* 1,000  b.)  ensemble  averaged  Rg(l)  using  10,000  realizations  c.)  sample  variance  of 
the  biased  R^fl)  d.)  analytical  variance  of  biased  Rt(I). 


Fig  7.C.9  Time-averaged  autocorrelation  function  and  its  variance  for  X=0.7  and  os-4  a.)  biased  Rj(l) 

(6  trials)  using  Ny= 1 ,000  b.)  ensemble  averaged  Rg(l)  using  10,000  realizations  c.)  sample  variance  of 
the  biased  Rj(l)  d.)  analytical  variance  of  biased  Rj(l). 


Fig  7.C.10  Time-averaged  autocorrelation  function  and  its  variance  for  X=0.9  and  ag-4  a.)  biased  Rj(l) 

(6  trials)  using  Np= 1,000  b.)  ensemble  averaged  Rg(l)  using  10,000  realizations  c.)  sample  variance  of 
the  biased  Rj(l)  d.)  analytical  variance  of  biased  R-y<l). 


D.  The  Cross-Correlation  Function  Ergodicity  Results 

In  this  section,  we  will  palliate  the  ergodicity  of  the  cross-correlation 
function.  This  will  be  accomplished  by  evaluating  the  variance  of  the  time- 
averaged  cross-correlation  function  as  determined  by  its  ergodic  series.  In 
Section  IV.B,  we  developed  the  expression  for  the  variance  described  by 
eq(4.B.13).  In  this  section,  we  will  consider  an  expression  for  the  variance  of  the 
biased,  time-averaged  cross-correlation  function  estimator  using  limited  data. 
Following  a  similar  discussion  as  presented  in  Section  VII.C,  eq(4.B.13)  is 
modified  for  the  biased  estimator  such  that 


VBij(l,N)  =  SC 


Nt-III-1 

1  r  i  n+ikn  * 

m  I  1  -  ^  RetRiiQOR^k)  +  Fij(l,k)].  (7.D.1) 
T  k=-(NT-lll-l)L  T  J  JJ 


We  will  now  consider  the  case  of  a  two  channel  AR(1)  process  with  real 
correlation  functions.  Table  7.D.1  lists  the  parameters  used  in  the  synthesis 
procedure  of  section  VI.  Table  7.D.2  lists  the  A(l)  and  C  matrices  used  in  the 
AR  process  synthesis  equation  expressed  by  eqs(6.B.5)  and  (6.B.6).  We  note  that 
in  each  of  the  A(l)  matrices 


1 

P 

II 

(7.D.2a) 

and 

_a22  “  ^22 

(7.D.2b) 

while 

a12  *  a21  ~  0* 

(7.D.2c) 
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We  also  note  that  the  cross-correlation  between  the  process  is  controlled  by 
the  elements  of  the  C  matrices;  ie.,  for  high  correlation,  the  cn  and  C21  elements 

become  nearly  equal  while  C22  diminishes.  For  low  correlation,  the  C21  element 
diminishes.  From  eqs(7.D.2),  each  channel  process  is  an  AR(1)  process  such  that 

Rll(k)  =  Oll(A-n)lkl  (7.D.3a) 

and 

R22(k)  =  022(X22)lk'-  (7.D.3b) 

As  in  the  previous  section,  we  can  show  (see  Section  VI.C  and  Appendix  G)  that 
when  Ry(k)  is  real,  the  in-phase  and  quadrature  components  of  the  synthesized 

outputs  are  uncorrelated  so  that 

R^(a)  =  Rjj*«x)  =  0.  (7.D.4) 

We  also  show  that  in  the  case  where 

Ry(a)  =  Ry°(a)  (7.D.5) 

so  that  Fy(IJc)=0,  eq(7.D.l)  can  be  written  as 


Nt-III-1 


vBijO.N) = n;  I , 

1  T  k=-(NT-lll-l) 


lll+lkl] 

Nt  Jc 


(Xu)  C22  (^22) 


(7.D.6) 


In  Fig  7.D.1,  the  peak  value  of  VB„(I)  which  occurs  at  1=0  is  plotted  (solid 

curves)  as  a  function  of  ^ar=^1  1=^22  for  Ny  =  100  and  N-p  =  1000  using  the 

2  2 

analytic  expression  of  eq(7.D.6)  and  Ojp  ^22=^'  The  corresPon^^ng  Pea^ 
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values  of  the  sample  variances  of  the  time-averaged  cross-correlation  function 

estimates  computed  using  the  synthesized  data  processes  are  also  plotted  (x)  on 
this  curve.  These  values  were  computed  using  NR  realizations  of  the  functions. 

For  Nt  =  100,  NR  =  10,000  was  used  while  for  NT  =  1000,  the  number  of 
realizations  was  reduced  to  NR  =  1,000.  The  sample  variances  based  on  NR 

realizations  of  the  time-averaged  cross-correlation  function  estimates  are 
computed  using  the  expression 

Nr 

Var[ftijTb(l,NT):NR]  =  £  l^ijTb(l,NT|a)  -  ftijTb(l,NRla)l2  (7.D.7) 


where 


K  a=l 


N, 


(7.D.8) 


and  ^ijT^(^NRla)  is  the  biased,  time-averaged,  cross-correlation  function  for 
realization  a. 

Figs  7.D.2  through  7.D.10  show  the  results  for  these  variances  based  on  the 

computed  values  of  eq(7.D.7)  and  the  analytic  expression  of  eq(7.D.6).  Table 

7.D.1  contains  the  parameters  used  in  the  process  synthesis  procedure.  In  these 

2  2 

cases,  the  variance  of  the  processes  Oj  jand  o22  was  held  fixed  at  4  while  \  and 

^22  wcrc  var*ed  from  0.1  to  0.99.  The  cross-correlation  coefficient  Ip^l  had 

values  of  0.99, 0.5  and  0.0.  Table  7.D.2  contains  the  A(l)  and  C  coefficients.  As 

noted  previously,  the  off  diagonal  terms  of  the  A(l)  coefficients  are  negligible. 
We  also  note  that  as  the  temporal  correlation  coefficients  Xjj  increase,  the 

diagonal  elements  of  A(l)  increase;  whereas,  changes  in  Ipyt  affect  the  c2j  and 
c22  elements  of  C. 
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Fig. 

2 

°11 

2 

°22 

Xn 

*22 

*12 

\pn\ 

Nt 

Nr 

*12 

7.D.2 

4 

4 

0.1 

0.1 

0.1 

0.99 

100 

1000 

0 

7.D.3 

0.50 

7.D.4 

0.00 

7.D.5 

0.5 

0.5 

0.5 

0.99 

7.D.6 

0.50 

7.D.7 

0.00 

7.D.8 

0.9 

0.9 

0.9 

0.99 

7.D.9 

0.50 

7.D.10 

0.00 

Table  7.D.1 

Fig.  A(l)  C 

1.99  0.0 

1.97  0.28 

1.99  0.0  I 

0.995  1.723  J 
1.99  0.0  1 

0.0  1.99  J 
1.732  0.0  1 

1.715  0.244  J 
1.732  0.0  I 

0.866  1.50  J 

Table  7.D.2 


7.D.2 


7.D.3 


7.D.4 


7.D.5 


7.D.6 


-0.1  4.7xl0’7 


4.7x10' 


r-o.i  0.0  1 

LO.O  -0.1  J 
r  -o.i  o.oi 

LO.O  -0.1  J 

r  -o.5  o.o  i 

L  0.0  -0.5  J 
r  -o.5  o.o  i 

L  0.0  -0.5  J 
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Fig. 


A(l) 


C 


'  -0.5  0.0  1 

■1.732  0.0  1 

7JX7 

.0.0  -0.5. 

.  0.0  1.732  J 

7.D.8 

■  -0.9  0.0  ' 

■0.872  0.0  1 

.0.0  -0.9. 

.0.863  0.123  J 

7JD.9 

■-0.9  0.0  ■ 

'0.872  0.0  1 

.0.0  -0.9. 

.0.436  0.755  J 

'  -0.9  0.0  1 

’  0.872  0.0  I 

7JD.10 

Lo.o  -0.9. 

L  0.0  0.872  J 

Table  7.D.2  (contin.) 

ic 

14 

12 
10 

1.4 

max  VBy(.)  “ 

OJ 
04 
04 
0l2 


Fig  7.D.1  Maximum  variance  of  the  time-averaged  exponentially  shaped 

2  2 

cross-correlation  function  with  On*<J22*4;  analytic  (-)  and  computed  (•). 
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realizations)  c.)  sample  variance  of  the  biased  Rj(l)  (1000  realizations)  d.)  analytical  variance  of  biased 


realizations)  c.)  sample  variance  of  the  biased  R'f(l)  (1000  realizations)  d.)  analytical  variance  of  biased 


6 


Fig  7.D.7  Time-averaged  cross-correlation  function  and  its  variance  for  lpj2l  =0.0,  ^1 1=^22=^  12=0-5* 
°11=022=4’  *12®°  a.)  b‘ased  RT(I)  (2  trials)  using  NT=100  b.)  ensemble  averaged  RE(I)  (1,000 
realizations)  c.)  sample  variance  of  the  biased  RT(I)  (1000  realizations)  d.)  analytical  variance  of  biased 

RT(0- 


realizations)  c.)  sample  variance  of  the  biased  RjCI)  (1000  realizations)  d.)  analytical  variance  of  biased 
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Appendix  A 

In  this  Appendix,  we  prove  that 


=  Rn;nj(t>  for  '  “i 
where  the  symbol  a  in  this  discussion  refer 


Ra  a  .(t)  =  E[fti(t)nj(t-x)] 
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to  the  Hilbert  tranform.  Consider 


(A.2a) 

(A.2b) 

(A. 2c) 

(A.3a) 

(A.3b) 

(A.3c) 


(A  .4a) 


P  =  <j>  -  X 

(A.4b) 

so  that 

a  *  if 

E[Si(t)nj(X)]  =  ]l  J  -^dp 

-OO 

(A.5a) 

= Kpf'-v = Kpjrt- 

(A.5b) 

Using  eq(A.5b)  in  (A.2c),  we  have 

oo 


These  results  also  hold  when  i  =  j. 


(A.6a) 

(A.6b) 

(A.6c) 


Appendix  B 

In  this  appendix,  we  derive  the  expression  for  the  variance  of  &jjT(l,N) 

expressed  by  eq(4.A.3a).  Consider  the  time  averaged  estimate  of  the 
autocorrelation  function;  ie., 

A  1  N 

RiiT(l,N)  =  2N^T  £  xi(n)xi  (n  - 1)  (B.l) 

n=-N 

where  the  symbol  a  in  this  discussion  designates  the  quantity  a:  an  estimate.  Let 

<j>(n,l)  =  xj(n)xj  (n  - 1)  (B.2) 

Assuming  stationarity,  the  covariance  of  0(n,l)  can  be  expressed  as 

C^k.l)  =  E[  { (|>(n,l)-E[<Kn,l)] }  { <t>*(n-k,l)  -  E[<>*(n-k,l)] }  ] 

=  E[<t>(n.l)<t>*(n-k,l)]  -  E[<|>(n,l)]E[<|> *(n-k,l)] 

-  E[<D(n.l)]E[(|>*(n-k,l)]  +  E[<Kn,l))E[<f>*(n-k,l)] 

=  R^Qc.l)  -  E[<j>(n,l)]E[<i>*(n-kJ)l 

where 

Rw(k,l)  =  E[(|)(n,l)<|)*(n  -  k.l)]. 

Assuming  stationarity,  we  have  from  eq(B.2), 


E[<|>(n,l)]  =  Rjjd) 

(B.5a) 

E[<»  *(n-k,l)]  =  R*j(l) 

(B.5b) 

(B.3a) 

(B.3b) 

(B.3c) 

(B.4) 
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(B.6a) 

(B.6b) 


so  that 

C^k,!)  =  R#(k,l)  -  lRii(!)l2 

=  E[xj(n)x-  (n  -  l)x-  (n  -  k)x >(n  - 1  -  k)]  -  !Rii(i)l2. 

Now  consider  the  variance  of  the  complex  estimate  ftjjT(l,N)  which  can  be 
expressed  as 


Vii(l,N)  =  E  {  [^iiT(l,N)-E[^iT(l,N)]][^iiT(l,N)-E[ftii^(l,N)]] } 
=  E[ftiiT(l>N)feiiT(l,N)]  -  E[£i;T(l,N)]E[ftii*(l,N)]. 


N  N 


Using  eq(B.l),  we  have 

1  i’N  I'N  4c  4c 

ftiiT(l,N)iiiT(l,N)  = - ~  X  E  xi(n)Xj  (n  -  l)x:  (p)xj(p  - 1) 

(2N+ir  n=-Np=-N 


so  that 


N  N 


i  1^1  4c  4c 

E[ftiiT(W&iij(l,N)]  = - 9  X  E  E[xi(n)x:  (n-l)xj  (p)xj(p-l)]. 

(2N+ir  n=-Np=-N 


Also,  from  eq(B.l) 


N 


E[ftiiT(l,N)]  =  I.RiiO) 


n=-N 


so  that 

E[fciiT(l,N)]E[ftii^(l,N)]  = 


N  N 


2  I  I  RiifflRii®- 


(2N+irn=.N  p=-N 


1 


N  N 


2  I  I  lRii®i2- 

(2N+1)2  n=-N  p=-N 


(B.7a) 

(B.7b) 

(B.8) 

(B.9) 

(B.10) 

(B.lla) 

(B.llb) 


Using  eqs(B.9)  and  (B.llb)  in  (B.7b),  we  obtain 

VjjOJSI)  =  - — 5  X  X  {E[xj(n)x‘(n-l)x*(p)xi(p-l)]-lRji(l)l2}. 

(2N+1)Z  n=-N  p-N 

(B.12) 

Using  eq(B.6b)  in  eq(B.12) 

]  N  N 

Vii(l,N)  = - 5  X  I  Cw(n  ■  p,l)  (B.13a) 

(2N+1)  n=-N  p=-N 
,  2N 

=  - X  2  [2N  +  1  -  Ikl]  CaM)  (B.13b) 

(2N+1)2  k=s-2N 

1  Ikl 

=  (2N+1)  ^jSj1  “  2N+l'l  (B.13c) 

We  now  derive  an  alternate  expression  for  the  variance  of  ftjjT(l,N)  using 

the  biased  time-averaged  autocorrelation  function.  In  this  case,  we  use  eq(7.C.l) 
with  M=Nt  so  that  eq(B.8)  becomes  for  positive  and  negative  I 


„  ,  Nrl-lNrl-l  *  „ 

feiiTuO»NT)^iiTh^’NT) =  Z  Z  xi(n)xi(n-l)xi(p)xj(p-l) 

NT  n=0  p=0 


0<I<Nt-1  (B.14a) 

Nrll|-lNrll|-l* 

=  ~2  Z  Z  x  i  (n)xj(n-lll)xi(p)xi  (p-lll) 

nT  n=0  p=0 


-(Nt-1)<I  <0  (B.14b) 


so  that 
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.  .  Nrl-lNrl-l  ,  , 

E[feiiTh(l,NT)ftiiTh(l,NT)  ] — j  S  S  E[xi(n)Xi  (n-Dx;  (p)xi(p-l)] 

D  Nt  n=0  p=0 

0  <  I  <  NT  -1  (B.15a) 

Nrli|-lNrll|-l  , 

=  —  2  Z  E[xj  (n)xi(n-|ll)xi(p)Xj  (p-lll)] 

nT  n=0  p=0 

-(Nt-^^I^O  (B.15b) 

Also, 

.  ,  Nt-I-1 

E[ftiiTb(WT)]  =  JJ-  2  Ra(l)  O  <  I  <  NT  - 1  (B.16a) 

T  n=0 
Nt-II|-1  , 

=  FT  I  Rii®  -(Nt-1)<I<0.  (B.16b) 

T  n— n 


so  that 

E[ftiiTb(WT)]E[feii^b(l,Nx)]  = 

Nfl-1  Nrl-1 

=  “7  I  S  iRii©!2  0  <  I  <  Nt  (B.17a) 

n=0  p=0 

Nrll|-lNrll|-l 

- -T  I  I  lRiiO)l2  -(Nt-1)<I<0.  (B.17b) 

nT  n=0  p=0 

Using  eqs(B.15)  and  (B.17)  in  the  expression 


VBii0.NT)  =  E[ftjiTb(I.NT)ftii^aNT)  ]  -  E[ftiiTb(l,NT)]E[ftii^b(l,NT)] 

(B.  18) 

we  obtain 


Nrl-lNrl-l  „  , 

VB..(I,NT)  =  -T  I  £  {E[xi(n)x.(n-l)xi(p)xi(p-l)]-lRii(l)l2} 

NT  n=0  p=0 

for  0  <  I  <  Nt  -1  (B.19a) 

Nt-II|-1Nt-II|-1  . 

=  —  I  S  { E[x ;  (n)Xj(n-lll)Xj(p)Xj  (p-lll)]  -  |RH(I)I2 } 
nT  n=0  p=0 


for  -(Nt-1)  <  1  <  0. 

(B.19b) 

Using  eq(B.6b)  in  (B.19) 

Nrl-1  Nt-I-1 

VBii(I.NT)  -  -T  I  I  Cw(n  -  p,l) 

Nt  n=0  p=0 

0  <  1  <  NT  -1 

(B.20a) 

Nt-III-INt-III-I* 

=  -2  S  I  CH(n  -  p,lll) 

Nt  n=0  p=0 

-(Nt-1)  <  1  <  0. 

(B.20b) 

We  now  let  k  =  n  -  p  where 

-(Nt  -1  -  1)  <  k  <  Nt  -1-1  for 

0  <  1  <  NT  -1 

(B.21a) 

-(Nt  -  III  - 1)  <  k  <  Nt  -  III  -  1  for 

-(Nx-1)  <  1  <  0. 

(B.21b) 

We  also  note  that  eq(B.21b)  is  equivalent  to  eq(B.21a)  for  all  1  so  that 

Nrll|-1 

Vb..(I,Nt)  =  -T  I  [Nx  -  III  -  Ikl]  CM(k,l)  0  <  1  <  Nx -1 

Nt  k=-(Nrll|-l) 

(B.22a) 
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Nrll|-1 

=  ~s  I  [NT  -  III  -  Ikl]  C6|b(k,lll)  -(Nt-1)<IS0.  (B.22b) 

Nt  k=-(Nrll|-l) 


However,  for  negative  lag  I,  we  have 

C^CkJII)  =  C^(k,\)  (B.23) 

so  that  after  dividing  the  bracketed  factor  by  one  of  the  NT  terms  in  the 


denominator 
VBii0.NT)  = 


Nrll|-1 

ft  I 

T  k=-(Nrll|-l) 


_+_lkl 
Nn 


!1  CH(k,l) 


(B.24) 


for  both  positive  and  negative  values  of  I.  In  Appendix  C,  we  show  that  the 
imaginary  terms  in  (^(kj)  cancel  when  summed  over  positive  and  negative 

values  of  k  so  that 


VBiifl>NT)=  g 


Nrll|-1 


T  v- 


lll+lkl 


k=-(Nrll|-l)L 


N- 


T  J 


RelC^^Ck,!)}. 


(B.25) 


180 


Appendix  C 

In  this  appendix,  we  consider  the  term  Fjj(l,k)  in  eq(4.A.ll);  ie., 

Fii(l,k)  =  E[xi(n)Xi(n  - 1  -  k)]E[x*(n  -  l)x*(n  -  k)].  (C.l) 

Expressing  the  process  Xj(n)  in  terms  of  its  quadrature  components 
E[xj(n)xj(n  - 1  -  k)]  = 

=  E { [xjjCn)  +  jxiQ(n)][xjj(n  -  I  -  k)  +  jxjQ(n  - 1  -  k)] }  (C.2a) 

=  {  r"(I  +  k)  -  +  k) }  +  j  {  R?‘(l  +  k)  +  R-f  (I  +  k) }  (C.2b) 

and 

E[xj  (n  -  \)x{  (n  -  k)]  = 

=  E  { [x^n  - 1)  -  jxjQ(n  -  l)][xu(n  -  k)  -  jxiQ(n  -  k)] }  (C.3a) 

=  { R»(k  - 1)  -  R  nQ(k  - 1) }  -  j  { Rjf(k  - 1)  +  R»*<k  - 1) }  (C.3b) 

(C.4a) 
(C.4b) 
(C.4c) 
(C.4d) 

so  that  eq(C.3b)  becomes 


But 

R,“(k  - 1)  =  r"(I  -  k) 

R?Q(k  - 1)  =  Rjfd  -  k) 
Ru'(k  - 1)  =  R^t!  -  k) 
R*?(k  - 1)  =  Rjj*(l  -  k) 
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(C.5) 


E[xj  (n  -  l)xj  (n  -  k)]  = 

=  {  r"(I  -  k)  -  R  i^d  -  k)  }  -  j  {  R?‘(l  -  k)  +  R -f  (I  -  k)  } . 


Substituting  eqs(C.2b)  and  (C.5)  into  (C.l),  we  obtain 

FijdJO  =  {  r"(I  +  k)  -  R  i^d  +  k) }  {  r"(I  -  k)  -  R  jfd  -  k) } 

+  { R^’d  +  k)  +  Rjj\l  +  k) }  { R^d  -  k)  +  R-f (I  -  k) } 

-  j  { R"(l  +  k)  -  R?Q(I  +  k) }  {  Rjf(l  -  k)  +  R|?(,  -  k) } 

+ j  { R-’(l  -  k)  -  R^l  -  k) }  { Ru’d  +  k)  +  R-f (I  +  k) } .  (C.6) 

When  the  function  Fji(l,k)  is  used  in  eq(4.A.12),  and  the  limit  as  N->°°  is  taken,  it 
contributes  the  additional  term  in  the  summation 


lim 

N-»oo 


1 

2N+1 


2N 

I 
k=-2Nl 


Ikl  ' 
'  2N+1 


Fjid,k>. 


(C.7) 


By  examination  of  eq(C.6),  we  note  that  the  imaginary  terms  in  eq(C.7) 
sum  to  zero.  This  can  be  seen  by  first  noting  that  Fjj(l,k)  is  real  for  k=0.  We  also 


note  that  imaginary  terms  evaluated  with  negative  values  of  k  serve  to  cancel  the 

corresponding  imaginary  terms  for  positive  values  of  k.  And  so,  only  the  real 
part  of  the  function  Fjj(l,k)  contributes  to  the  function  Ljj(l) .  Therefore, 


lim 

N-*oo 


1 

2N+1 


,kl  1„  f  /11X1 

2N+iJ  RelF^U)}. 


(C.8) 
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Examination  of  the  real  terms  in  eq(C.6)  indicate  that  identical  terms  are 
contributed  by  each  positive  and  negative  k  value  so  that  eq(C.8)  can  also  be 
written 


1  2N  r  Ik!  1  , 

lH(|)  =  Jo  L1  -2NTi!  {2Re(Fii(l,k»  -  Fjj(l,0) } .  (C.9) 


The  term  F|j(l,0)  is  subtracted  in  the  above  equation  so  that  it  is  not  counted 
twice.  If  we  now  define 


II  QQ 

RCii(a)  =  Rii(a)-Rii  (a) 


(C.lOa) 


=  R  .jf(a) +  Ri?(«) 

eq(C.8)  becomes 

l  2N  r 

Lii(l)  =  lim«rr-r  £  1  - 

N->oo2N+I  k=-2NL 

i  2n  r 

=  lim  ■,  £  1 

N->ooZIN+i  k=-2NL 


Ikl 

2N+1 


If  the  corresponding 
then  (see  Section  m.E.2.a), 


Ikl 

2N+1 


’  Re{Fu(l,k)} 

- 

[J  [RcjjO  +  k)RCii(l  -  k) 


(C.lOb) 


(C.1 1 ') 


+  RD..(I  +  k)RD..(l  -  k)]  (C.1  lb) 


processes  are  stationary  and  narrowband. 


R,"(a)  =  R?Q(a) 


(C.12a) 


RjjV*)  =  *[?(«). 


(C.1 2b) 
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Using  eqs(C.12a)  and  (C.12b)  in  (C.6),  we  obtain 


FU(U)  =  0.  (C.13) 

In  this  case,  eq(4.A.13b)  becomes 

Vii(|,N)  =  “2. 2N+1  k=?2i i1  "  2N+l]  *Rii^*  *  (C14) 
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Appendix  D 

In  this  appendix,  we  consider  the  terms  Fjj(l,k)  and  Rii(k)R jj(k)  in 
eq(4.B.10c).  Consider, 

*  * 

Fij(l,k)  =  E[xj(n)xj(n  - 1  -  k)]E[xj  (n  -  l)Xi  (n  -  k)].  (D.l) 

Expressing  the  processes  xj(n)  and  xj(n)  in  quadrature  form,  we  have 
E[xj(n)xj(n  - 1  -  k)]  = 

=  E  { [xij(n)  +  jxiQ(n)]  [xj^n  - 1  -  k)  +  jxjQ(n  - 1  -  k)] }  (D.2a) 

=  { Ry(l  +  k)  -  RyQ(l  +  k) }  +  j { Ry'fl  +  k)  +  R  •  j^l  +  k)  }  (D.2b) 


and 


E[xj  (n  -  l)x;  (n  -  k)]  = 


=  E{  [Xjj(n  - 1)  -  jxjQ(n  -  l)][xjj(n  -  k)  -  jxjQ(n  -  k)] } 

=  { R;l(k  - 1)  -  RnQ(k  - 1)}  -  j{R«r(k  - 1)  +  Rj?(k  - 1)} 


But 


Rjj(k  -  I)  =  Ry(l  -  k) 
RyQ(k  -  I)  =  Ry°(l  -  k) 
Rjf(k  - 1)  =  Ry\l  -  k) 
R]f(k  - 1)  =  Ry‘(l  -  k) 


(D.3a) 

(D.3b) 


(D.4a) 

(D.4b) 

(D.4c) 

(D.4d) 


so  that  eq(D.3b)  becomes 
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E[xj  (n  -  l)xj  (n  -  k)]  = 

=  {  r"(I  -  k)  -  R  yQd  -  k) }  -  j  { Ry’d  -  k)  +  Ry\l  -  k) } .  (D.5) 

Substituting  eqs(D.2b)  and  (D.5)  into  (D.l),  we  have 

Fjj(IJc)  =  { Ryd  +  k)  -  R^d  +  k) }  { Rjj(l  -  k)  -  Ry°d  -  k) } 

+  {Ry‘(l  +  k)  +  Ry\l  +  k)}  {Ry\l  -  k)  +  Ry\l  -  k)} 

-  j  { Ryd  +  k)  -  Ry^l  +  k))  {Rjj'd  -  k)  +  Rj^l  -  k)} 

+  j  {  Ryd  -  k)  -  Ry°(l  -  k)  }  {  Ry'd  +  k)  +  Ry\l  +  k) } .  (D.6) 

When  the  function  Fjj(l,k)  is  used  in  eq(4.B.14),  it  contributes  the  additional  term 
in  the  summation 


lim 

N-»oo 


1 

2N+1 


2N  r 
X  l 

k=-2NL 


(D.7) 


As  in  the  case  for  Ljj(l)  expressed  by  eq(C.7),  the  imaginary  terms  in  eq(D.6) 
cancel  in  the  summation  of  eq(D.7).  Therefore,  only  the  real  part  of  Fy(l,k) 
contributes  to  the  term  Vjj(l,N)  so  that 

i  2n  r  ivi 

Lii(l)  =  n1So2N+1  "  2N+lJ  RelFii('’k)}-  (°-8) 

Examination  of  the  real  terms  in  eq(D.6)  indicate  that  identical  terms  are 
contributed  by  each  positive  and  negative  k  value  so  that  eq(D.S)  becomes 
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LU®  =  li  [»  -  2^r]  f  2Re{Fij(|,k>}  -  Fij(l,0)}.  (D.9) 

The  term  Fy(l,0)  is  subtracted  in  the  above  equation  so  that  it  is  not  counted 
twice.  We  now  consider  the  second  term  in  eq(4.B.10c);  ie., 

Rjj(k)Rjj(k)  =  E[xj(n)xj  (n  -  k)]E[xj  (n  -  l)xj(n  - 1  -  k)].  (D.10) 

Now 

E[xj(n)xj  (n  -  k)]  = 

=  E{  [xjjCn)  +  jxiQ(n)][xiI(n-  k)  -  jxiQ(n-  k)] }  (D.l  la) 

=  {R"(k)  +  Raffle))  +  j { R-f(k)  -  R-f (k) )  (D.l lb) 

and 

E[xj  (n  -  l)xj(n  - 1  -  k)]  = 

*  E{  [xjX(n  - 1)  -  jxjQ(n  -  l)3[xjj(n  - 1  -  k)  +  jxjQ(n  - 1  -  k)]  (D.12a) 

=  { RjJ(k)  +  Rjj°(k) )  -  j{Rjj‘(k)  -  R-^k) } .  (D.12b) 

And  so 

Rj;(k)R*j(k)  =  { R??(k)  +  R^OO }  { Rjj(k)  +  Rj-V) } 

+  {  R?'(k)  -  Rjj^(k) }  { R?‘(k)  -  Rjj\k) } 

-  j  { R "(k)  +  R  aQ(k) }  { Rjj'(k)  -  Rjj^(k) } 

+  j  { Rjj(k)  +  Rjj^(k) }  {  Rh  1 [(k)  -  R^(k) } .  (D.13) 
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Consider  the  imaginary  terms 


Im(R;i(k)R*j(k))  =  -j  R"(k)R-f(k)  -j  RjfoOR-V)  +  j  Rjj(k)R^(k) 

+j  R  jfWj^k)  +  j  Rjj(k)Rjj!(k)  +  j  RjjWjf (k) 


II  IQ  QQ  IQ 

*  j  Rjj(k)Rji  (k)  -  j  Rjj  (k)Rii  (k) 

(P-14) 

We  now  recall  that 

R?(k)  =  R*j(-k) 

(D.15a) 

QQ  QQ 

Rji  (k)  =  R h  (-k) 

(D.15b) 

QI  IQ 

Rii  (k)  =  Rh  (-k) 

(D.15c) 

IQ  QI 

Rii  (k)  =  R-j  (-k) 

(D.15d) 

with  equivalent  expressions  for  the  j  channel  processes. 

When  Rii(k)R*j(k)  is 

used  in  the  summation  of  eq(4.B.12),  we  recognize  that  the  terms  in  eq(D.14) 
will  cancel  when  the  positive  and  negative  k  values  are  determined.  For  example, 
the  first  term  in  this  equation  becomes  -j  R”(k)Rjj\k)  when  k  is  negative.  This 


term  will  cancel  the  third  term  in  the  equation  for  k  positive.  Similarly,  the 
other  terms  cancel.  A  similar  argument  can  be  used  to  determine  that  the  real 
terms  in  eq(D.13)  for  negative  k  equal  those  for  positive  k. 

Finally,  we  note  that  if  the  corresponding  bandpass  processes  are  jointly 
stationary  and  narrowband,  then  (see  Section  III.E.2.b), 
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(D.16a) 


and 


n  qq 
Rij(oc)  =  Rjj  (a) 


Ry‘(a)  =  -R-f(a). 


Using  these  equations  in  eq(D.6),  we  obtain 
Fij(l,k)  =  0. 

In  this  case,  eq(4.B.13)  becomes 


1  2N  f 
vij('»N)  =  2N+T  k-^Ni- 


1  - 


Ikl 


2N+1 


RetRii^RjjCk)]. 


(D.16b) 


(D.17) 


(D.18) 
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Appendix  E 

In  this  appendix,  we  verify  several  of  the  equations  noted  in  section 
m.C.4.b.  From  eq(3.C.60a) 

Ai  =  1  +  Kj  -  2(Xi  j)Kj  (E.la) 

-1+I^flCj -2Xn].  (E.lb) 

Taking  the  partial  derivative  of  Aj  with  respect  to  Kj,  we  have 
dAi 

=  (E.2a) 

and 

3^Aj 

— Y  =  +2.  (E.2b) 

aiq 

Eq(E.2a)  and  the  positive  value  of  eq(E.2b)  indicates  that  A  j  has  a  minimum 


value  at  Kj  «  X\  so  that 

Aj  >  1  +  Xjj  -  2XjX  (E.3a) 

>  1  -(Xu)2.  (E.3b) 

Since  0<  X\  j<1,  we  have 

Ai>l -(Xu)2^0  (E.4) 

so  that  eq(3.C.61a)  is  verified.  From  eq(3.C.60e) 

B  -  1  -  2(X12)2  +  (X12)4  (E.5a) 

-  [I  •  (Xi2)2]2.  (E.5b) 

Since  0<  Xj  j<1,  then  0<B<1.  From  eq(3.C.60f) 
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(E.6a) 

(E.6b) 


C  =  (Xt  !)2  +  (X22)2  -  (Xj  i)2(X22)2 
-  [Xn  -  X22I2  +  (Xn)2(X22)2 
so  that  0<C<1 . 
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Appendix  F 

In  this  appendix,  we  validate  eqs(7.C.8)  and  (7.C.9)  of  section  VII. 
Consider  the  complex  single  channel  i  AR  process  of  order  M 

M 

Xj(n)  a*  I  a*(k)xi(n  -  k)  +  u(n).  (F.l) 

k=l 

Expressed  in  quadratic  form,  we  have 


Xi(n) 


xij(n)  +  j  xjQ(n) 

M 

-  X  Wk)  +  j  a0(k)]  [xjjCn-k)  +  j  xWn-k)]  +  u,(n)  +  j  un(n) 
k=l  v  v 

M 


-  X  [•jOOxrfn-k)  +  aQ(k)xiq(n-k)]  +  Uj(n) 
f  M 


-J 


I 

k=l 


[aj(k)xiQ(n-k)  -  a^^x^n-k)]  +  uQ(n» 


so  that 

M 

xil(n)  =  *  X  [aI(k)xiI(n-k)  +  aQ(k)xiQ(n-k)]  +  ux(n) 
M 

*iQ(n)  =  -  X  [aI(k)xiQ(n-k)  -  aQ(k)xiI(n-k)]  +  uQ(n). 


(F.2a) 

(F.2b) 


(F.2c) 


(F.3a) 

(F.3b) 


In  general,  Xjj(n)  and  Xjq(n)  will  be  correlated  for  ap(k)  *  0  since  they 
both  contain  terms  involving  xjj(n-k)  and  xjq(n-k).  However,  for  aQ(k)=0, 

eqs(F.3a)  and  (F.3b)  reduce  to 
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M 

*il(n)  =  -  £  ajC^XjjCn-k)  +  Uj(n)  (F.4a) 

k=l 
M 

xio(n> =  ■  £  aj(k)xiQ(n-k)  +  uQ(n).  (F.4b) 

k=l  v 

In  this  case,  Xj^n)  and  Xjq(n)  are  uncorrelated  provided  their  white  noise 

driving  terms  are  uncorrelated.  In  the  process  synthesis  procedure  described  in 

Section  VI,  a(k)  will  be  real  when  the  correlation  function  is  specified  to  be  real. 
And  so,  ag=0  and 

Ry  (k)  =  RyV)  =  0.  (F.5) 

From  eqs(F.4a)  and  (F.4b),  we  also  note  that  both  quadrature  components  are  AR 
processes  with  the  same  coefficients  and  equal  white  noise  driving  variances. 
Therefore, 

n  QQ 

Rji(k)  =  Rji  (k).  (F.6) 

We  also  note  that  in  the  simulation  process  described  in  section  VI,  we  first 

2 

solve  for  the  white  variance  term  ou  in  the  Yule-Walker  equation.  We  then 

divide  this  quantity  by  1/2  and  apply  this  variance  to  each  quadrature  component 
of  the  white  noise  driving  term.  At  k=0,  we  therefore  expect  to  obtain  the  result 

2 

n  QQ  °ii 

Rii(0)  *  Ru  (0)  =  y.  (F.7) 
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Appendix  G 

In  this  appendix,  we  validate  eqs(7.D.4)  and  (7.D.5)  of  Section  VII. 
Consider  the  complex  two  channel  AR  process  of  order  M 


M 

i(n)  =  -  X  AH(k)i(n-k)  +  u(n)  (G.l) 

k=l 

Expressed  in  quadratic  form,  we  have 


i(n)  =  i!(n)  +  j  sq(n)  (G.2a) 

M 

=  -  ^X  [Alfo  +  jAQ(k)]H[xi(n-k)  +  j  XQ(n-k)]  +  ^(n)  +  juQ(n)  (G.2b) 

M  fp  m 

=  -  X  tAi(k)  -  jAQ(k)]  [xi(n-k)  +  j  Sn(n-k)]  +  ^(n)  +  jjiQ(n)  (G.2c) 
k=l 

M  m  rp 

=  -  X  [Al  (k)ii(n-k)  +  AQ(k)xQ(n-k)]  +  uT(n) 
k=l 


-  j  {  X  [ aI (k)Xn(n-k)  -  An(k)xI(n-k)]  +  Wn) }  (G.2d) 

k=l 


so  that 

il(n)  *  -  X  [A  I  (k)ij(n-k)  +  AQ(k)jQ(n-k)]  +  in(n)  (G.3a) 


Nd  rp  pp 

io(n)  =  -  X  [A  I  (k)xn(n-k)  -  AQQOijCn-k)]  +  un(n) 
k=l 


(G.3b) 


T 

In  general,  ij(n)  and  jQ(n)  will  be  correlated  for  AqOO  ^  0  since  they  both 

T 

contain  terms  involving  ij(n-k)  and  XQ<n-k).  However,  for  AqOO  =  0,  eqs(G.3a) 
and  (G.3b)  reduce  to 


M  T 

il(o>  =  -  X  AI  (k)ii(n-k)  +  iij(n)  (G.4a) 

k=l 

M  T 

XQ(n)  =  -  X  AI  (k)XQ(n-k)+  UQ(n)  (G.4b) 

k=l 


Written  in  expanded  form,  the  two  channel  processes  become 


xll(n)* 

M 

an(k)  a2i(k) 

xn(n"k)" 

'un(n)‘ 

2Li(n)  = 

.x2l(n>. 

=  -  s 

k-1 

ai2(k)a22(k) 

x2I(n-k) 

+ 

u2i(n) 

and 

2q( n)  = 


XiQ(n) 

x2Q(n) 


an(k)  a2i(k) 
ai2(k)a22(k) 


x1Q(n-k) 

x2Q(n-k) 


ulQ(n> 

u2Q(n) 


(G.5a) 


(G.5b) 


In  the  process  synthesis  procedure  described  in  Section  VI. A  and  VI.B,  the 
quadrature  components  of  the  white  noise  driving  vectors  are  all  uncorrelated. 
Therefore, 


Rl2(k)  =  R  n(k)  =  0.  (G.6) 

We  also  note  from  eqs(G.5a)  and  (G.5b)  that  the  vector  processes  &i(n)  and 
jq( n)  are  AR  processes  which  have  identical  parameters.  We  therefore  have 
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(G.7a) 


R?l(k)  =  R??(k) 

R^(k)  =  R^(k) 

and 

R°(k)  =  R?? (k). 

These  results  validate  eqs(7.D.4)  and  (7.D.5). 


(G.7b) 

(G.7c) 
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Appendix  H 

In  this  appendix,  we  validate  eq(4.A.10c).  Consider  eq(4.A.9b)  expressed 
as 


*  * 


R<j><j>(U)  =  E[xj(n)xj  (n  -  l)xj  (n  -  k)xj(n  - 1  -  k)]. 

(H.l) 

Consider 

xi(n)  =  Xii(n)  +  j  Xjq(n). 

(H.2) 

Using  eq(H.2)  in  (H.l),  we  obtain 

R<jHj>(k,l)  =  E{  [xjx(n)  +  j  Xjq(n)][xii(n-I)  -  j  Xjq(n-I)] 

•  [xji(n-k)  -  j  x}Q(n-k)][x}j(n-l-k)  +  j  Xjq(n-l-k)] }  (H.3a) 

=  E  { [xii(n)xix(n-l)+XiQ(n)xjQ(n-l)+jxiQ(n)xii(n-l)-jxix(n)xiQ(n-l)] 


.[xij(n-k)xii(n-l-k)+xiQ(n-k)xiQ(n-l-k)+jxix(n-k)xiQ(n-l-k) 

-jxiQ(n-k)xii(n-l-k)] }  (H.3b) 

=  E[xix(n)xix(n-l)xii(n-k)xix(n-l-k)]  +  EtxjqO^Xiqfa-Oxjifr-k^ixfa-l-k)] 

+  E[xjx(n)xji(n-l)xjq(n-k)xiq(n-l-k>]  +  E[xjq(n)xjq(n-l)xiq(n-k)xiq(n-l-k)] 

-  E[xjq(n)xjx(n-l)xji(n-k)xjq(n-l-k)]  +  E[xji(n)xiq(n-l)xii(n-k)xiq(n-l-k)] 

+  E[xiq(n)xjx(n-l)xjq(n-k)xix(n-l-k)]  -  E[xix(n)xiq(n-l)xjq(n-k)xji(n-l-k)] 
+jE[xii(n)xji(n-l)xix(n-k)xjq(n-l-k)]  -  jE[xix(n)xjx(n-l)xjq(n-k)xji(n-l-k)] 
+jE[xjq(n)xjq(n-l)xji(n-k)xjq(n-l-k)]  -  jE[xiq(n)xiq(n-l)xiq(n-k)xii(n-l-k)] 
+jE[xiq(n)xii(n-l)xii(n-k)xii(n-l-k)]  +  jE[xiq(n)xix(n-l)xiq(n-k)xiq(n-l-k)] 
-jE[xii(n)xiq(n-l)xji(n-k)xix(n-l-k)]  -  j  E[xix(n)xiq(n-l)xiq(n-k)xjq(n-l-k)] 

(H.3c) 

For  Gaussian,  zero-mean  quadrature  components,  eq(H.3c)  can  be  expressed  as 
(dropping  the  i  subscript) 
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R^(k,l)  =  Rn(l)  +  Rn(k)  +  Rn0  +  k)Rn(k  - 1) 

+  Rqq(I)Rh(1)  +  RqiOO  +  Rqi(I  +  k)Rqi(k  - 1) 

+  rh<ORqq(I)  +  RiqOO  +  Riq(I  +  k)RjQ(k  - 1) 

+  Rqq(I)  +  RqqOc)  +  Rqq(!  +  k)RQq(k  - 1) 

■  Rqi(0Riq(0  '  RQi(k)RiQ(k)  -  Rqq(I  +  k)Rn(k  - 1) 

+  Riq(I)  +  Rn(k)RQQ(k)  +  Riq(I  +  k)Rgi(k  - 1) 

+  Rqi(I)  +  RQQ(k)Rn(k)  +  Rqi(I  +  k)RIQ(k  - 1) 

•  Riq(ORqiO)  "  RiQ(k)RQi(k)  -  Rn(l  +  k)RqQ(k  - 1) 

+j  {Rii(0Riq(0  +  Rn(k)RiQ(k)  +  Rjq(I  +  k)Rn(k  - 1)} 

■j  {  Rh^RqiCO  +  RiQ(k)R„(k)  +  Rn(l  +  k)RjQ(k  - 1)} 

+j  {Rqq(I)Riq(I)  +  Rqi^RqqOc)  +  Rqq(I  +  k^flc  - 1)} 

-j  {Rqq(DRqi(I)  +  RQQ(k)RQi(k)  +  Rqj(I  +  k)RQQ(k  - 1)} 

+j  {Rqi(0Rh(O  +  RQl(k)Rn(k)  +  Rqi(I  +  k)Rn(k  - 1)} 

+j  {RqiO)Rqq(I)  +  RQQ(k)RiQ(k)  +  Rqq(I  +  k)RjQ(k  - 1)} 

-j  {RiQ(l)Rn(l)  +  Rn(k)RQi(k)  +  Rn(l  +  k)RQI(k  - 1)} 

■j  {  Riq(0Rqq(O  +  RiQ(k)RQQ(k)  +  Riq(I  +  k)RqQ(k  - 1) } .  (H.4) 

where  we  note  that  the  first  two  terms  in  each  parenthesis  for  the  imaginary 
terms  cancel.  Since 

R(D  -  Pntf)  +  RqqO)]  +  j  [RqiO)  -  Riq(I)]  (H.5) 
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; 

then 

|R(I)I2  =  Rn(D  +  2R]j(I)Rqq(I)  +  Rqq(I)  +  RqiW  -  2Rqi(I)Riq(I)  +  R?q(I) 

(H.6) 

and  similarly  for  lR(k,l)l^  so  that 

R^OcJ)  =  iRjjd)!2  +  lRjj(k)l2  +  Fu(l,k)  (H.7) 

where 

Fii(IJc)  =  {  R?(l  +  k)  -  R?Q(I  +  k) }  { R?(l  -  k)  -  Rf(l  -  k) } 

+  { RjjVl  +  k)  +  R'p(l  +  k) }  { R^’d  -  k)  +  r[9(I  -  k) ) 

-  j  {  R?(l  +  k)  -  Rf(l  +  k) }  { R^’d  -  k)  +  R?P(I  -  k) } 

+  j  {R?(l  -  k)  -  r9Q(I  -  k>}  {R^d  +  k)  +  R?P(I  +  k)}  (H.8) 


as  noted  in  eq(C.8b)  of  Appendix  C. 
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